-- Logs begin at Thu 2022-05-26 15:42:59 UTC, end at Thu 2022-05-26 17:08:45 UTC. -- May 26 16:31:36.327482 dv-cinder-836071-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 16:31:36.339755 dv-cinder-836071-5-iscsi devstack@n-api.service[109791]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 16:31:36.341736 dv-cinder-836071-5-iscsi devstack@n-api.service[109791]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 16:31:36 2022] *** May 26 16:31:36.341736 dv-cinder-836071-5-iscsi devstack@n-api.service[109791]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 16:31:36.341736 dv-cinder-836071-5-iscsi devstack@n-api.service[109791]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 16:31:36.341736 dv-cinder-836071-5-iscsi devstack@n-api.service[109791]: nodename: dv-cinder-836071-5-iscsi May 26 16:31:36.341736 dv-cinder-836071-5-iscsi devstack@n-api.service[109791]: machine: x86_64 May 26 16:31:36.341736 dv-cinder-836071-5-iscsi devstack@n-api.service[109791]: clock source: unix May 26 16:31:36.341736 dv-cinder-836071-5-iscsi devstack@n-api.service[109791]: pcre jit disabled May 26 16:31:36.341736 dv-cinder-836071-5-iscsi devstack@n-api.service[109791]: detected number of CPU cores: 4 May 26 16:31:36.341736 dv-cinder-836071-5-iscsi devstack@n-api.service[109791]: current working directory: / May 26 16:31:36.341736 dv-cinder-836071-5-iscsi devstack@n-api.service[109791]: detected binary path: /usr/bin/uwsgi-core May 26 16:31:36.341736 dv-cinder-836071-5-iscsi devstack@n-api.service[109791]: your processes number limit is 47680 May 26 16:31:36.341736 dv-cinder-836071-5-iscsi devstack@n-api.service[109791]: your memory page size is 4096 bytes May 26 16:31:36.342890 dv-cinder-836071-5-iscsi devstack@n-api.service[109791]: detected max file descriptor number: 2048 May 26 16:31:36.342890 dv-cinder-836071-5-iscsi devstack@n-api.service[109791]: lock engine: pthread robust mutexes May 26 16:31:36.342890 dv-cinder-836071-5-iscsi devstack@n-api.service[109791]: thunder lock: enabled May 26 16:31:36.342890 dv-cinder-836071-5-iscsi devstack@n-api.service[109791]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 16:31:36.342890 dv-cinder-836071-5-iscsi devstack@n-api.service[109791]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 16:31:36.389549 dv-cinder-836071-5-iscsi devstack@n-api.service[109791]: Python main interpreter initialized at 0x560dd47179c0 May 26 16:31:36.389549 dv-cinder-836071-5-iscsi devstack@n-api.service[109791]: python threads support enabled May 26 16:31:36.389549 dv-cinder-836071-5-iscsi devstack@n-api.service[109791]: your server socket listen backlog is limited to 100 connections May 26 16:31:36.389549 dv-cinder-836071-5-iscsi devstack@n-api.service[109791]: your mercy for graceful operations on workers is 90 seconds May 26 16:31:36.389998 dv-cinder-836071-5-iscsi devstack@n-api.service[109791]: mapped 403077 bytes (393 KB) for 2 cores May 26 16:31:36.389998 dv-cinder-836071-5-iscsi devstack@n-api.service[109791]: *** Operational MODE: preforking *** May 26 16:31:36.390270 dv-cinder-836071-5-iscsi devstack@n-api.service[109791]: *** uWSGI is running in multiple interpreter mode *** May 26 16:31:36.390270 dv-cinder-836071-5-iscsi devstack@n-api.service[109791]: spawned uWSGI master process (pid: 109791) May 26 16:31:36.390481 dv-cinder-836071-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 16:31:36.391094 dv-cinder-836071-5-iscsi devstack@n-api.service[109791]: spawned uWSGI worker 1 (pid: 109792, cores: 1) May 26 16:31:36.395176 dv-cinder-836071-5-iscsi devstack@n-api.service[109791]: spawned uWSGI worker 2 (pid: 109793, cores: 1) May 26 16:31:36.395176 dv-cinder-836071-5-iscsi devstack@n-api.service[109791]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 16:31:37.666564 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 16:31:37.670502 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 16:31:38.462777 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:31:38.462777 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: from cryptography.utils import int_from_bytes May 26 16:31:38.463157 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:31:38.463157 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: from cryptography.utils import int_from_bytes May 26 16:31:38.477070 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:31:38.477070 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: from cryptography.utils import int_from_bytes May 26 16:31:38.477427 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:31:38.477427 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: from cryptography.utils import int_from_bytes May 26 16:31:41.316932 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 16:31:41.317519 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 16:31:41.317726 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 16:31:41.318089 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 16:31:41.318351 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 16:31:41.318740 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.319070 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.319396 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.319720 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.320052 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.320364 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.320774 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.321098 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.321432 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.321694 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.322007 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.322462 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 16:31:41.322868 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 16:31:41.323062 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836071-5-iscsi {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.323233 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 16:31:41.323405 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.323720 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.323844 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 16:31:41.323995 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 16:31:41.324326 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.324461 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.324681 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.324775 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.324993 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.325084 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.325324 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.325415 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.325634 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.325733 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.325991 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.326137 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.327347 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.327472 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.327553 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.327622 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.327695 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.327761 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.327832 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.327832 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.327965 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.328031 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836071-5-iscsi {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.328101 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.328172 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.328244 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.328556 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.328664 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.328743 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.328810 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.329022 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.329124 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.329326 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.329428 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.329646 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.329756 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836071-5-iscsi {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.329953 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.330047 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.330364 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.330513 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.330678 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.330799 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.331042 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.331364 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.331472 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.331683 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.331799 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.332003 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.332111 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.332309 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.332451 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.332741 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.333059 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.333185 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.333388 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.333709 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.333856 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.334030 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.334147 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.334394 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.334640 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.334798 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836071-5-iscsi {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.334922 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.335202 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.335365 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.335516 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.335682 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.335839 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.336006 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.336446 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.336558 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.336765 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.336869 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.337038 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.337127 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.337352 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.337448 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.337680 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.337779 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.337991 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.338080 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.338318 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.338407 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.338571 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.338686 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.338848 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.338949 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.339149 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.339256 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.339472 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.339563 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.339782 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.340431 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.340648 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.340790 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.340961 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.341091 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.341272 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.341405 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.341580 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.341718 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.341857 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.341982 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.342112 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.342243 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.342430 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.342585 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.342749 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.342878 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.343068 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.343208 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.343344 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.343486 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.343612 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.343746 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.343879 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.344012 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.344146 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.344465 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.102 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.344605 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.344805 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.102 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.344932 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.345056 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.345266 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.345403 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.345536 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.345663 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.345803 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.345937 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.346072 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.346196 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.346319 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.346510 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.346638 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.346822 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.346957 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.347130 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.347256 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.347436 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.347562 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.347741 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.347868 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.348055 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.348190 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.348365 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.348546 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.102 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.348762 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.348892 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.102 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.349017 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.349140 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.349263 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.349387 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.349520 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.349655 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.349823 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.349952 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.350132 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.350270 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.350442 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.350578 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.350747 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.350886 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.351058 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.351203 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.351368 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.351504 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.351679 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.351806 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.351989 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.352131 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.352289 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.352435 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.352575 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.352714 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.352873 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.353015 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.353176 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.353304 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.353490 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.353618 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.353792 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.353932 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.354098 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.354226 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.354402 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.354559 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.354716 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.354931 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.355059 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.355184 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.355322 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.355448 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.355617 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.355754 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.355927 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.356088 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.356235 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.356364 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.356569 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.357244 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.357372 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.357496 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.357653 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.357782 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.357946 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.358073 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.358255 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.358386 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.358572 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.358701 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.358920 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.359049 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.359179 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.359304 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.359469 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.359607 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.359775 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.359912 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.360092 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.360221 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.360514 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.360651 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.360790 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.360923 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.361055 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.361179 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.361310 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.361435 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.361576 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.361702 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.361881 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.362017 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.362186 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.362324 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.362487 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.362615 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.362799 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.362926 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.363098 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.363235 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.363404 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.363541 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.363710 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.363837 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.364012 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.364149 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.364315 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.364456 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.364640 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.364768 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.364944 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.365077 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.365248 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.365348 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.365550 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.365655 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.365850 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.365948 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.366151 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.366246 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.366447 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.366556 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.366763 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.366858 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.367080 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.367175 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.367388 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.367483 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.367695 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.367792 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.367997 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.368091 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.368312 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:31:41.368426 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.368668 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.368765 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.368992 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.369086 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.369322 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.369426 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.369633 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.369728 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.369944 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.370038 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.370262 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.370367 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.370575 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.370671 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.370881 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.370975 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.371218 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.371376 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.371541 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.371670 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.371850 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.371978 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.372157 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.372319 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.372595 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.372765 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.372893 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.373022 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.373145 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.373282 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.373428 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.373565 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.373742 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.373869 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.374055 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.374192 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.374366 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.374492 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.374670 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.374796 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.374985 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.375129 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.375308 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.375445 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.375624 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.375752 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.375932 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.376061 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.376246 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.376425 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.376619 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.376745 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.376927 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.377065 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.377241 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.377367 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.377553 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.377679 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.377860 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.377989 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.378167 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.378305 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.378473 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.378611 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.378789 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.378918 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.379135 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.379264 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.379410 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.379549 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.379723 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.379850 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.380030 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.380156 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.380336 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.380494 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.380667 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.380802 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.381012 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.381148 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.381274 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.381409 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.381585 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.381713 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.381893 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.382021 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.382202 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.382332 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.382512 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.382640 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.382828 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.382962 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.383133 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.383269 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.383441 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.383576 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.383748 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.383882 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.384047 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.384175 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.384347 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.384496 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.384670 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.384812 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.384977 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.385112 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.385275 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.385410 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.385591 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.385729 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.385896 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.386024 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.386203 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.386340 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.386516 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.386652 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.387325 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.387457 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.387637 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.387766 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.387944 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.388107 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.388281 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.388468 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.388595 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.388720 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.388899 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.389041 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.389248 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.389376 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.389509 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.389646 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.389807 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.389937 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.390113 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.390263 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.390414 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.390597 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.390735 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.390905 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.391033 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.391230 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.391358 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.391558 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.391700 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.391874 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.392004 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.392179 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.392321 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.392511 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.392653 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.392816 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.392954 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.393123 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.393252 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.393430 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.393559 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.393736 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.393864 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.394039 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.394166 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.394346 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.394475 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.394652 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.394780 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.394958 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.395095 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.395293 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.395420 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.395573 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.395701 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.395871 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.395999 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.396177 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.396312 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.396524 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.396650 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.396774 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.396911 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.397072 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.397220 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.397423 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.397627 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.397791 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.397966 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.398208 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.398350 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.398535 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.398686 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.398814 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.398945 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.399081 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.399201 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.399449 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.399653 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.399844 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.399986 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.400157 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.400287 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.400435 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.400578 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.400719 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.400846 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.400970 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.401126 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.401252 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.401385 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.401523 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.401649 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.401840 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.401969 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.402166 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.402296 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.402584 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.403208 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.403401 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.403528 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.403715 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.403843 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.404021 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.404158 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.404329 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.404531 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.404659 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.404804 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.404964 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.405101 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.405283 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.405404 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.405593 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.405730 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.405911 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.406047 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.406219 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.406355 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.406536 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.406676 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.406842 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.406969 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.407154 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.407280 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.407454 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.407596 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.407764 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.407900 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.408085 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.408211 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.408432 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.408577 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.408737 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.408864 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.409053 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.409188 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.409357 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.409821 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.409950 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.410055 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.410232 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.410348 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.410540 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.410718 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.410893 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.411141 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.411457 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.411647 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.411776 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.411964 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.412123 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.412357 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.412694 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.412998 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.413150 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.413313 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.413441 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.413614 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.413742 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.413922 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.414060 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.414238 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.414366 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.414549 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.414679 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.414854 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.414983 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.415161 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.415288 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.415475 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.415601 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.415780 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.415907 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.416086 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.416222 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.416407 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.416540 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.416713 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.416844 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.417013 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.417143 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.417317 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.417453 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.417621 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.417749 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.417923 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.418079 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.418251 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.418389 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.418551 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.418679 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.418859 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.418995 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.419162 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.419299 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.419461 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.419603 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.419761 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.419971 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.420108 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.420243 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.420395 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.420521 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.420693 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.420821 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.421007 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.421149 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.421315 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.421443 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.421610 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.421737 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.421910 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.422038 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.422226 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.422355 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.422529 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.422657 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.422828 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.422968 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.423126 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.423262 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.423424 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.423562 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.423760 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.423889 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.424062 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.424200 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.424365 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.424539 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.424709 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.424835 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.425000 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.425128 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.425306 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.425517 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.425643 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.425768 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.425892 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.426016 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.426200 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.426337 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.426516 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.426644 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.426825 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.426951 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.427127 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.427263 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.427434 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.427572 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.427738 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.427865 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.428042 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.428181 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.428349 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.428503 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.428688 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.428953 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.429099 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.429286 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.429413 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.429592 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.429734 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.429898 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.430120 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.430250 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.430375 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.430508 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.430649 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.430863 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.431051 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.431181 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.431381 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.431530 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.431695 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.431843 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.432011 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.432149 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.432328 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.432514 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.432677 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.432807 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.433005 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.433147 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.433329 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.433459 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.433634 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.433783 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.433963 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.434107 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.434272 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.434409 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.434570 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.434697 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.434872 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.435000 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.435174 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.435301 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.435471 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.435605 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.435769 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.435908 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.436069 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.436198 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.436392 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.436524 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.436690 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.436834 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.436991 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.437120 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.437291 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.437419 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.437590 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.437729 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.437892 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.438020 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.438189 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.438323 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.438495 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.438632 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.438793 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.438922 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.439108 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.439237 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.439412 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.439541 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.439709 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.439838 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.440010 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.440233 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.440394 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.440522 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.440647 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.440772 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.440952 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.441081 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.441284 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.441414 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.441585 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.441712 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.441897 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.442034 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.442207 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.442336 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.442503 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.442638 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.442813 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.442950 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.443110 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.443239 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.443407 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.443535 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.443707 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.443845 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.444010 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.444138 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.444308 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.444519 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.444656 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.444791 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.444918 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.445042 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.445213 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.445351 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.445515 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.445657 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.445819 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.445949 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.446119 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.446248 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.446422 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.446551 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.446720 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.446848 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.447031 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.447169 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.447337 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.447467 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.447634 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.447763 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.447932 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.448060 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.448234 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.448394 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.448560 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.448687 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.448859 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.448990 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.449194 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.449831 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.449961 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.450085 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.450278 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.450413 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.450578 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.450679 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.450876 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.450973 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.451174 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.451279 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.451478 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.451584 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.451779 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.451874 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.452073 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.452185 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.452396 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.452504 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.452707 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.452800 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.453010 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.453106 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.453310 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.453396 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.453614 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.453717 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.453915 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.454013 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.454210 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.454297 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.454511 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.454596 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.454819 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.454907 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.455121 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.455214 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.455416 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.455502 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.455720 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.455816 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.456016 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.456111 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.456313 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.456420 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.456638 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.456727 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.456942 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.457028 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.457239 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.457347 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.457538 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.457625 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.457838 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.457932 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.458134 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.458234 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.458433 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.458520 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.458748 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.458835 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.459051 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.459145 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.459351 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.459437 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.459649 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.459745 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.459947 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.460043 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.460288 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.460414 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.460610 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.460697 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.460919 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.461010 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.461231 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.461317 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.461544 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.461640 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.461857 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.461943 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.462158 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.462244 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.462463 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.462822 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.462822 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.463013 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.463101 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.463187 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.463390 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.463478 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.463695 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.463783 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.464006 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.464105 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.464302 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.464409 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.464629 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.464717 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.464964 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.465082 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.465791 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.465902 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.466101 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.466188 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.466410 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.466498 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.466720 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.466815 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.467034 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.467120 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.467332 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.467418 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.467636 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.467731 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.467943 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.468036 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.468248 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.468335 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.468578 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.468684 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.468880 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.468966 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.469186 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.469272 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.469488 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.469575 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.469793 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.469880 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.470103 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.470189 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.470412 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.470506 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.470710 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.470799 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.471011 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.471096 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.471311 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.471404 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.471609 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.471696 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.471924 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.472038 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.472227 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.472352 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.472552 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.472685 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.472855 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.472992 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.473154 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.473304 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.473459 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.473617 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.473758 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.473935 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.474182 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.474276 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.474491 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.474578 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.474799 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.474946 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.475098 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.475260 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.475405 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.475574 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.475713 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.475887 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.476025 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.476194 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.476333 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.476535 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.476662 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.476850 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.477076 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.477162 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.477383 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.477469 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.477691 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.477787 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.477998 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.478090 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.478296 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.478383 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.478595 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.478684 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.478900 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.478999 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.479216 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.479359 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.479513 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.479675 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.479812 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.479981 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.480113 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.480424 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.480517 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.480766 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.480864 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.481079 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.481166 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.481403 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.481493 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.481725 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.481812 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.482049 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.482136 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.482356 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.482451 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.482715 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.482942 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.483034 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.483128 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.483294 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.483404 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.483616 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.483705 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.483929 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.484018 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.484236 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.484323 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.484570 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.484664 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.484875 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.484963 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.485197 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.485295 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.485508 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.485602 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.485815 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.485902 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.486127 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.486226 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.486465 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.486672 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.486760 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.486840 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.487050 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.487148 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.487359 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.487468 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.487675 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.487761 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.488066 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.488162 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.488427 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.488620 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.488755 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.488839 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.488994 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.489077 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.489312 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.489408 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.489611 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.489698 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.489912 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.490001 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.490224 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.490319 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.490525 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.490612 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.490825 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.490913 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.491127 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.491220 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.491429 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.491516 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.491737 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.491824 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.492043 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.492137 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.492346 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.492515 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.492668 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.492763 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.492968 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.493055 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.493283 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.493382 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.493584 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.493678 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.493897 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.493985 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.494204 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.494301 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.494511 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.494606 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.494817 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.494903 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.495116 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.495215 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.495432 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.495520 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.495737 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.495830 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.496039 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.496164 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.496405 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.496531 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.496688 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.496775 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.497026 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.497115 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.497330 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.497415 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.497644 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.497731 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.497969 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.498072 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.498293 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.498379 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.498596 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.498696 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.498901 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.498989 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.499212 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.499298 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.499515 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.499611 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.499819 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.499914 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.500128 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.500223 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.500451 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.500552 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.500753 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.500847 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.501054 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.501139 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.501350 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.501445 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.501648 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.501735 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.501947 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.502046 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.502249 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.502337 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.502548 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.502648 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.502846 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.502933 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.503144 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.503232 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.503445 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.503536 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.503744 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.503831 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.504059 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.504148 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.504360 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.504502 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.504681 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.504770 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.504980 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.505069 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.505276 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.505364 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.505613 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.505712 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.505914 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.506013 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.506241 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.506336 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.506553 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.506652 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.506869 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.506955 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.507187 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.507274 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.507491 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.507585 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.507808 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.507893 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.508120 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.508207 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.508451 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.508552 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.508764 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.508851 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.509113 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.509219 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.509390 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.509486 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.509699 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.509952 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.510039 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.510286 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.510388 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.510605 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.510693 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.510913 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.511046 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.511225 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.511325 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.511540 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.511764 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.512479 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.512641 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.512736 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.512952 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.513041 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.513260 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.513348 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.513567 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.513664 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.513875 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.513963 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.514183 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.514278 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.514491 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.514636 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.514798 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.514885 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.515102 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.515190 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.515407 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.515502 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.515731 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.515820 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.516049 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.516135 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.516386 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.516476 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.516746 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.516833 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.517055 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.517142 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.517364 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.517457 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.517675 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.517763 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.517986 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.518146 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.518300 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.518389 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.518614 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.518702 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.518924 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.519018 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.519234 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.519328 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.519543 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.519630 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.519848 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.519942 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.520157 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.520250 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.520490 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.520592 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.520804 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.520893 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.521112 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.521198 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.521418 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.521504 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.521723 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.521812 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.522032 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.522125 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.522345 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.522444 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.522666 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.522865 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.522992 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.523185 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.523305 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.523523 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.523612 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.523851 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.523939 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.524179 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.524266 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.524525 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.524733 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.524845 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.525045 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.525180 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.525374 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.525474 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.525695 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.525781 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.526014 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.526107 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.526326 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.526430 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.526640 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.526727 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.526966 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.527051 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.527268 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.527363 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.528106 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.528203 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.528433 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.528522 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.528740 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.528829 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.529042 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.529276 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.529371 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.529627 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.529723 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.529939 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.530025 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.530255 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.530341 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.530563 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.530664 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.530882 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.531094 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.531193 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.531444 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.531544 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.531759 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.531853 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.532082 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.532168 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.532413 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.532513 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.532727 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.532814 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.533029 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.533121 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.533334 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.533436 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.533640 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.533726 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.533943 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.534030 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.534244 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.534332 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.534818 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.534916 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.535118 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.535204 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.535422 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.535510 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.535733 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.535830 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.536035 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.536120 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.536333 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.536472 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.536665 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.536754 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.536969 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.537057 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.537274 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.537363 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.537581 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.537668 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.537882 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.537977 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.538183 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.538269 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.538485 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.538576 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.538784 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.538878 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.539087 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.539176 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.539388 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.539473 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.539688 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.539784 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.539999 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.540084 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.540299 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.540403 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.540633 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.540732 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.540934 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.541029 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.541242 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.541376 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.541544 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.541641 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.541849 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.541937 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.542177 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.542263 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.542490 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.542579 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.542798 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.542884 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.543121 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.543212 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.543434 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.543522 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.543740 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.544006 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.544093 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.544342 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.544480 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.544674 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.544759 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.545007 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.545104 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.545315 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.545410 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.545635 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.545847 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.545934 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.546174 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.546271 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.546492 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.546579 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.546821 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.546915 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.547140 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.547239 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.547443 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.547541 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.547746 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.547833 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.548050 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.548214 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.548357 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.548467 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.548688 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.548777 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.548994 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.549081 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.549301 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.549398 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.549605 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.549691 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.549912 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.550000 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.550218 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.550303 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.550526 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.550614 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.550831 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.550917 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.551138 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.551234 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.551445 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.551544 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.551750 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.551838 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.552057 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.552144 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.552362 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.552497 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.552696 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.552782 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.553026 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.553111 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.553339 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.553441 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.553651 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.553736 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.553965 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.554051 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.554280 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.554375 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.554588 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.554675 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.554892 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.554990 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.555199 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.555300 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.555504 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.555615 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.555817 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.555934 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.556142 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.556255 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.556474 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.556596 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.556777 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.556920 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.557194 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.557282 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.557503 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.557591 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.557820 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.557919 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.558128 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.558214 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.558433 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.558519 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.558774 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.558874 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.559093 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.559179 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.559401 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.559491 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.559719 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.559807 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.560026 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.560120 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.560346 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.560492 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.560683 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.560778 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.561002 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.561089 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.561314 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.561445 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.561616 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.561712 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.561918 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.562004 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.562219 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.562304 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.562522 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.562608 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.562827 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.562914 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.563131 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.563228 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.563429 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.563515 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.563731 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.563816 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.564030 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.564124 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.564330 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.564435 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.564655 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.564740 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.564953 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.565049 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.565258 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.565384 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.565558 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.565671 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.565854 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.565967 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.566154 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.566252 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.566454 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.566553 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.566752 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.566877 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.567050 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.567165 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.567425 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.567532 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.567656 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.567762 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.567956 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.568043 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.568259 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.568345 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.568583 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.568680 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.568888 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.568975 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.569188 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.569276 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.569515 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.569604 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.569843 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.569930 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.570153 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.570249 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.570469 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.570554 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.570780 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.570875 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.571097 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.571195 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.571402 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.571497 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.571714 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.571800 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.572029 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.572126 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.572339 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.572445 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.572669 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.572770 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.572980 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.573094 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.573291 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.573378 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.573600 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.573694 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.573909 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.573997 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.574217 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.574303 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.575055 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.575144 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.575369 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.575482 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.575688 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.575785 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.576004 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.576102 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.576307 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.576429 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.576654 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.576753 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.576965 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.577148 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.577285 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.577384 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.577596 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.577689 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.577904 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.578000 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.578222 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.578308 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.578530 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.578615 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.578837 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.578932 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.579150 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.579235 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.579460 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.579594 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.579772 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.579860 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.580084 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.580171 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.580417 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.580522 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.580745 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.580833 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.581072 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.581159 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.581378 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.581467 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.581700 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.581788 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.582015 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.582100 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.582324 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.582420 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.582571 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 16:31:41.582660 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.582986 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.583311 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.583624 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.583936 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.584243 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:31:41.584508 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 16:31:41.642838 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO dbcounter [None req-e3d0b95b-5698-46e7-b473-449bd998bcf8 None None] Registered counter for database nova_api May 26 16:31:41.646298 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO dbcounter [None req-710e30d0-4030-4c70-bfbc-8b5400b0850d None None] Registered counter for database nova_api May 26 16:31:41.666283 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG oslo_db.sqlalchemy.engines [None req-e3d0b95b-5698-46e7-b473-449bd998bcf8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:31:41.667968 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG oslo_db.sqlalchemy.engines [None req-710e30d0-4030-4c70-bfbc-8b5400b0850d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109793) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:31:41.674715 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG dbcounter [-] [109793] Writer thread running {{(pid=109793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:31:41.675031 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG dbcounter [-] [109792] Writer thread running {{(pid=109792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:31:41.731704 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.context [None req-710e30d0-4030-4c70-bfbc-8b5400b0850d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),97163b7c-dec1-42e2-8be2-4fecb8140df7(cell1) {{(pid=109793) load_cells /opt/stack/nova/nova/context.py:464}} May 26 16:31:41.733335 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.context [None req-e3d0b95b-5698-46e7-b473-449bd998bcf8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),97163b7c-dec1-42e2-8be2-4fecb8140df7(cell1) {{(pid=109792) load_cells /opt/stack/nova/nova/context.py:464}} May 26 16:31:41.735833 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG oslo_concurrency.lockutils [None req-710e30d0-4030-4c70-bfbc-8b5400b0850d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:31:41.737463 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-e3d0b95b-5698-46e7-b473-449bd998bcf8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:31:41.737692 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG oslo_concurrency.lockutils [None req-710e30d0-4030-4c70-bfbc-8b5400b0850d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:31:41.738251 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG oslo_concurrency.lockutils [None req-710e30d0-4030-4c70-bfbc-8b5400b0850d None None] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:31:41.739060 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-e3d0b95b-5698-46e7-b473-449bd998bcf8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:31:41.739877 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-e3d0b95b-5698-46e7-b473-449bd998bcf8 None None] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:31:41.740231 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG oslo_concurrency.lockutils [None req-710e30d0-4030-4c70-bfbc-8b5400b0850d None None] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:31:41.741900 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-e3d0b95b-5698-46e7-b473-449bd998bcf8 None None] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:31:41.742254 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO dbcounter [None req-710e30d0-4030-4c70-bfbc-8b5400b0850d None None] Registered counter for database nova_cell0 May 26 16:31:41.743889 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO dbcounter [None req-e3d0b95b-5698-46e7-b473-449bd998bcf8 None None] Registered counter for database nova_cell0 May 26 16:31:41.746758 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO dbcounter [None req-710e30d0-4030-4c70-bfbc-8b5400b0850d None None] Registered counter for database nova_cell1 May 26 16:31:41.748975 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO dbcounter [None req-e3d0b95b-5698-46e7-b473-449bd998bcf8 None None] Registered counter for database nova_cell1 May 26 16:31:41.753917 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG oslo_db.sqlalchemy.engines [None req-710e30d0-4030-4c70-bfbc-8b5400b0850d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109793) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:31:41.755476 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG oslo_db.sqlalchemy.engines [None req-710e30d0-4030-4c70-bfbc-8b5400b0850d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109793) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:31:41.757096 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG oslo_db.sqlalchemy.engines [None req-e3d0b95b-5698-46e7-b473-449bd998bcf8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:31:41.760294 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG oslo_db.sqlalchemy.engines [None req-e3d0b95b-5698-46e7-b473-449bd998bcf8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:31:41.762041 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG dbcounter [-] [109793] Writer thread running {{(pid=109793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:31:41.763798 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG dbcounter [-] [109792] Writer thread running {{(pid=109792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:31:41.901777 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG dbcounter [-] [109793] Writer thread running {{(pid=109793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:31:41.904031 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG dbcounter [-] [109792] Writer thread running {{(pid=109792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:31:41.911921 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO dbcounter [None req-710e30d0-4030-4c70-bfbc-8b5400b0850d None None] Registered counter for database nova_cell0 May 26 16:31:41.913185 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO dbcounter [None req-e3d0b95b-5698-46e7-b473-449bd998bcf8 None None] Registered counter for database nova_cell0 May 26 16:31:41.920775 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG oslo_db.sqlalchemy.engines [None req-710e30d0-4030-4c70-bfbc-8b5400b0850d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109793) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:31:41.924329 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG oslo_db.sqlalchemy.engines [None req-e3d0b95b-5698-46e7-b473-449bd998bcf8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:31:41.925325 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG dbcounter [-] [109793] Writer thread running {{(pid=109793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:31:41.928786 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG dbcounter [-] [109792] Writer thread running {{(pid=109792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:31:42.278007 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: WARNING keystonemiddleware.auth_token [None req-e3d0b95b-5698-46e7-b473-449bd998bcf8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 16:31:42.281800 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: WARNING keystonemiddleware.auth_token [None req-710e30d0-4030-4c70-bfbc-8b5400b0850d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 16:31:42.285472 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: WARNING keystonemiddleware.auth_token [None req-e3d0b95b-5698-46e7-b473-449bd998bcf8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 16:31:42.289283 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: WARNING keystonemiddleware.auth_token [None req-710e30d0-4030-4c70-bfbc-8b5400b0850d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 16:31:42.627227 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: WARNING keystonemiddleware.auth_token [None req-e3d0b95b-5698-46e7-b473-449bd998bcf8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 16:31:42.631546 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: WARNING keystonemiddleware.auth_token [None req-710e30d0-4030-4c70-bfbc-8b5400b0850d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 16:31:42.633078 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: WARNING keystonemiddleware.auth_token [None req-e3d0b95b-5698-46e7-b473-449bd998bcf8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 16:31:42.638063 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: WARNING keystonemiddleware.auth_token [None req-710e30d0-4030-4c70-bfbc-8b5400b0850d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 16:31:42.638859 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560dd47179c0 pid: 109792 (default app) May 26 16:31:42.640955 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-e3d0b95b-5698-46e7-b473-449bd998bcf8 None None] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:31:42.642143 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-e3d0b95b-5698-46e7-b473-449bd998bcf8 None None] 10.222.0.102 "GET /compute/v2.1/" status: 200 len: 389 microversion: 2.1 time: 0.001778 May 26 16:31:42.642546 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 1/1] 10.222.0.102 () {50 vars in 793 bytes} [Thu May 26 16:31:42 2022] GET /compute/v2.1/ => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:31:42.643343 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560dd47179c0 pid: 109793 (default app) May 26 16:33:04.195533 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-e3d0b95b-5698-46e7-b473-449bd998bcf8 None None] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:33:04.196582 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-e3d0b95b-5698-46e7-b473-449bd998bcf8 None None] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001486 May 26 16:33:04.197176 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 2/2] 10.222.0.102 () {54 vars in 935 bytes} [Thu May 26 16:33:04 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:33:04.210212 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG dbcounter [-] [109793] Writing DB stats nova_api:SELECT=3 {{(pid=109793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:04.211467 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG dbcounter [-] [109793] Writing DB stats nova_cell0:SELECT=3 {{(pid=109793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:04.212311 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG dbcounter [-] [109793] Writing DB stats nova_cell1:SELECT=3 {{(pid=109793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:04.213227 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG dbcounter [-] [109793] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:04.661717 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-0425cdcb-f7b9-43af-83a5-ffaee8737b15 admin admin] Calling method '>' {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:33:04.692952 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.requestlog [None req-0425cdcb-f7b9-43af-83a5-ffaee8737b15 admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.487945 May 26 16:33:04.693821 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: [pid: 109793|app: 0|req: 1/3] 10.222.0.102 () {60 vars in 1296 bytes} [Thu May 26 16:33:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:33:07.080313 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-e3d0b95b-5698-46e7-b473-449bd998bcf8 None None] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:33:07.081371 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-e3d0b95b-5698-46e7-b473-449bd998bcf8 None None] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001483 May 26 16:33:07.081778 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 3/4] 10.222.0.102 () {54 vars in 935 bytes} [Thu May 26 16:33:07 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:33:07.151734 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-e63d5b47-5386-44dd-b936-e58488481278 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "id": "c1", "ram": 256, "name": "cirros256", "disk": 1, "os-flavor-access:is_public": true}} {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:33:07.187269 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:33:07.187269 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: warnings.warn(msg) May 26 16:33:07.223996 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.requestlog [None req-e63d5b47-5386-44dd-b936-e58488481278 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.61 time: 0.135429 May 26 16:33:07.233058 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: [pid: 109793|app: 0|req: 2/5] 10.222.0.102 () {64 vars in 1287 bytes} [Thu May 26 16:33:07 2022] POST /compute/v2.1/flavors => generated 409 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:33:07.445955 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-bad27685-6279-48de-9c91-f8e1c239d9f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:33:07.448466 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:33:07.448466 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: warnings.warn(msg) May 26 16:33:07.451677 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG dbcounter [-] [109792] Writing DB stats nova_api:SELECT=3 {{(pid=109792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:07.452696 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG dbcounter [-] [109792] Writing DB stats nova_cell0:SELECT=3 {{(pid=109792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:07.453817 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG dbcounter [-] [109792] Writing DB stats nova_cell1:SELECT=3 {{(pid=109792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:07.454635 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG dbcounter [-] [109792] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:07.529660 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-bad27685-6279-48de-9c91-f8e1c239d9f7 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.293985 May 26 16:33:07.532453 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 4/6] 10.222.0.102 () {64 vars in 1340 bytes} [Thu May 26 16:33:07 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:33:09.995343 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-e63d5b47-5386-44dd-b936-e58488481278 admin admin] Calling method '>' {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:33:09.996624 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.requestlog [None req-e63d5b47-5386-44dd-b936-e58488481278 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001709 May 26 16:33:09.997043 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: [pid: 109793|app: 0|req: 3/7] 10.222.0.102 () {54 vars in 935 bytes} [Thu May 26 16:33:09 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:33:10.131756 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-f3cd0555-f6a6-4350-aa3b-86f58675f8b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "swap": 0, "name": "ds512M", "os-flavor-access:is_public": true, "vcpus": 1, "disk": 5, "rxtx_factor": 1.0}} {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:33:10.152294 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:33:10.152294 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: warnings.warn(msg) May 26 16:33:10.175675 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-f3cd0555-f6a6-4350-aa3b-86f58675f8b0 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.171681 May 26 16:33:10.181126 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 5/8] 10.222.0.102 () {64 vars in 1287 bytes} [Thu May 26 16:33:10 2022] POST /compute/v2.1/flavors => generated 406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:33:10.189551 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-a102f0f8-18cd-400e-af78-cb7ff37a84a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:33:10.191045 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:33:10.191045 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: warnings.warn(msg) May 26 16:33:10.235942 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.requestlog [None req-a102f0f8-18cd-400e-af78-cb7ff37a84a0 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.051056 May 26 16:33:10.236569 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: [pid: 109793|app: 0|req: 4/9] 10.222.0.102 () {64 vars in 1340 bytes} [Thu May 26 16:33:10 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:33:12.637833 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-f3cd0555-f6a6-4350-aa3b-86f58675f8b0 admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:33:12.639409 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-f3cd0555-f6a6-4350-aa3b-86f58675f8b0 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001542 May 26 16:33:12.640005 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 6/10] 10.222.0.102 () {54 vars in 935 bytes} [Thu May 26 16:33:12 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:33:12.710410 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-3365c04d-60ac-45ab-be81-31f79cb70c0f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "d2", "rxtx_factor": 1.0, "ram": 1024, "disk": 10, "name": "ds1G", "swap": 0}} {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:33:12.733363 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.requestlog [None req-3365c04d-60ac-45ab-be81-31f79cb70c0f admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.086151 May 26 16:33:12.734198 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: [pid: 109793|app: 0|req: 5/11] 10.222.0.102 () {64 vars in 1287 bytes} [Thu May 26 16:33:12 2022] POST /compute/v2.1/flavors => generated 406 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 16:33:12.747063 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-f48f1484-b0c2-4b72-a89a-f9554ccbb516 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:33:12.775597 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-f48f1484-b0c2-4b72-a89a-f9554ccbb516 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032384 May 26 16:33:12.776306 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 7/12] 10.222.0.102 () {64 vars in 1340 bytes} [Thu May 26 16:33:12 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:33:15.242009 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-3365c04d-60ac-45ab-be81-31f79cb70c0f admin admin] Calling method '>' {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:33:15.243165 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.requestlog [None req-3365c04d-60ac-45ab-be81-31f79cb70c0f admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001506 May 26 16:33:15.243654 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: [pid: 109793|app: 0|req: 6/13] 10.222.0.102 () {54 vars in 935 bytes} [Thu May 26 16:33:15 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:33:15.307393 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-02519a0f-927a-4286-b06c-dd24e7d08af9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "disk": 10, "os-flavor-access:is_public": true, "vcpus": 2, "swap": 0}} {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:33:15.326879 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-02519a0f-927a-4286-b06c-dd24e7d08af9 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.074601 May 26 16:33:15.327539 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 8/14] 10.222.0.102 () {64 vars in 1287 bytes} [Thu May 26 16:33:15 2022] POST /compute/v2.1/flavors => generated 406 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:33:15.339459 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-2f6c2d08-e7a3-4fc8-8476-14ad9bd5fa61 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:33:15.366014 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.requestlog [None req-2f6c2d08-e7a3-4fc8-8476-14ad9bd5fa61 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030210 May 26 16:33:15.366729 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: [pid: 109793|app: 0|req: 7/15] 10.222.0.102 () {64 vars in 1340 bytes} [Thu May 26 16:33:15 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:33:17.769712 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-02519a0f-927a-4286-b06c-dd24e7d08af9 admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:33:17.771339 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-02519a0f-927a-4286-b06c-dd24e7d08af9 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002073 May 26 16:33:17.772308 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 9/16] 10.222.0.102 () {54 vars in 935 bytes} [Thu May 26 16:33:17 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:33:17.856178 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-91032308-34d2-4e74-bba7-b1110cc721d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 4096, "rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "id": "d4", "vcpus": 4, "swap": 0}} {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:33:17.877266 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.requestlog [None req-91032308-34d2-4e74-bba7-b1110cc721d3 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.093589 May 26 16:33:17.878011 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: [pid: 109793|app: 0|req: 8/17] 10.222.0.102 () {64 vars in 1287 bytes} [Thu May 26 16:33:17 2022] POST /compute/v2.1/flavors => generated 406 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:33:17.895460 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-ed893084-6c07-48d7-82c6-c142b61b41d5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:33:17.927871 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-ed893084-6c07-48d7-82c6-c142b61b41d5 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035927 May 26 16:33:17.929544 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 10/18] 10.222.0.102 () {64 vars in 1340 bytes} [Thu May 26 16:33:17 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:33:20.283025 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-91032308-34d2-4e74-bba7-b1110cc721d3 admin admin] Calling method '>' {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:33:20.284120 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.requestlog [None req-91032308-34d2-4e74-bba7-b1110cc721d3 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001518 May 26 16:33:20.284625 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: [pid: 109793|app: 0|req: 9/19] 10.222.0.102 () {54 vars in 935 bytes} [Thu May 26 16:33:20 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:33:20.400784 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-cc94836d-9c55-4f6b-8b92-7b05bc4ec14c admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:33:20.425831 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-cc94836d-9c55-4f6b-8b92-7b05bc4ec14c admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2116 microversion: 2.61 time: 0.132012 May 26 16:33:20.427504 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 11/20] 10.222.0.102 () {60 vars in 1296 bytes} [Thu May 26 16:33:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2116 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:33:22.856718 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-91032308-34d2-4e74-bba7-b1110cc721d3 admin admin] Calling method '>' {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:33:22.857743 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.requestlog [None req-91032308-34d2-4e74-bba7-b1110cc721d3 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001545 May 26 16:33:22.858187 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: [pid: 109793|app: 0|req: 10/21] 10.222.0.102 () {54 vars in 935 bytes} [Thu May 26 16:33:22 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:33:22.927455 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-c85c0bbc-b7cc-47b7-a31e-8fb035c12bbe admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "name": "m1.tiny", "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0}} {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:33:22.947412 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-c85c0bbc-b7cc-47b7-a31e-8fb035c12bbe admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081610 May 26 16:33:22.947986 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 12/22] 10.222.0.102 () {64 vars in 1287 bytes} [Thu May 26 16:33:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:33:22.963920 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-15661b4c-04c0-4c6a-92f1-ab30f583ce95 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:33:22.994176 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.requestlog [None req-15661b4c-04c0-4c6a-92f1-ab30f583ce95 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033900 May 26 16:33:22.995166 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: [pid: 109793|app: 0|req: 11/23] 10.222.0.102 () {64 vars in 1337 bytes} [Thu May 26 16:33:22 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:33:25.542239 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-c85c0bbc-b7cc-47b7-a31e-8fb035c12bbe admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:33:25.544034 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-c85c0bbc-b7cc-47b7-a31e-8fb035c12bbe admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002578 May 26 16:33:25.544804 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 13/24] 10.222.0.102 () {54 vars in 935 bytes} [Thu May 26 16:33:25 2022] GET /compute/v2.1 => generated 389 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:33:25.644460 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-d068fe11-0640-49df-bf9b-1afe6c2653df admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 2048, "name": "m1.small", "id": "2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:33:25.668480 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.requestlog [None req-d068fe11-0640-49df-bf9b-1afe6c2653df admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.115886 May 26 16:33:25.669052 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: [pid: 109793|app: 0|req: 12/25] 10.222.0.102 () {64 vars in 1287 bytes} [Thu May 26 16:33:25 2022] POST /compute/v2.1/flavors => generated 407 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:33:25.686499 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-47a4425f-acbe-4f84-a98f-0a3e724f0820 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:33:25.721545 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-47a4425f-acbe-4f84-a98f-0a3e724f0820 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039413 May 26 16:33:25.722261 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 14/26] 10.222.0.102 () {64 vars in 1337 bytes} [Thu May 26 16:33:25 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:33:28.157213 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-d068fe11-0640-49df-bf9b-1afe6c2653df admin admin] Calling method '>' {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:33:28.158439 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.requestlog [None req-d068fe11-0640-49df-bf9b-1afe6c2653df admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002614 May 26 16:33:28.158995 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: [pid: 109793|app: 0|req: 13/27] 10.222.0.102 () {54 vars in 935 bytes} [Thu May 26 16:33:28 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:33:28.263679 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-443b5fa7-f2a7-4ecc-b962-fa01b54968a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "rxtx_factor": 1.0, "id": "3", "os-flavor-access:is_public": true, "disk": 40}} {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:33:28.290320 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-443b5fa7-f2a7-4ecc-b962-fa01b54968a4 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.122045 May 26 16:33:28.291238 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 15/28] 10.222.0.102 () {64 vars in 1287 bytes} [Thu May 26 16:33:28 2022] POST /compute/v2.1/flavors => generated 408 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:33:28.305242 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-c7c1c290-db6d-487d-9590-ce479c606cea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:33:28.339825 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.requestlog [None req-c7c1c290-db6d-487d-9590-ce479c606cea admin admin] 10.222.0.102 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037980 May 26 16:33:28.340833 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: [pid: 109793|app: 0|req: 14/29] 10.222.0.102 () {64 vars in 1337 bytes} [Thu May 26 16:33:28 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:33:30.732795 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-443b5fa7-f2a7-4ecc-b962-fa01b54968a4 admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:33:30.733842 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-443b5fa7-f2a7-4ecc-b962-fa01b54968a4 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001509 May 26 16:33:30.735065 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 16/30] 10.222.0.102 () {54 vars in 935 bytes} [Thu May 26 16:33:30 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:33:30.795213 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-0fcff536-914c-4478-913a-459e07cb843e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "id": "4", "rxtx_factor": 1.0, "disk": 80, "ram": 8192, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4}} {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:33:30.815126 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.requestlog [None req-0fcff536-914c-4478-913a-459e07cb843e admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.073159 May 26 16:33:30.815906 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: [pid: 109793|app: 0|req: 15/31] 10.222.0.102 () {64 vars in 1287 bytes} [Thu May 26 16:33:30 2022] POST /compute/v2.1/flavors => generated 407 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:33:30.832763 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-56ee11c2-a992-4b4f-a27e-979eab558993 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:33:30.868822 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-56ee11c2-a992-4b4f-a27e-979eab558993 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043031 May 26 16:33:30.869682 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 17/32] 10.222.0.102 () {64 vars in 1337 bytes} [Thu May 26 16:33:30 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:33:33.469443 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-0fcff536-914c-4478-913a-459e07cb843e admin admin] Calling method '>' {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:33:33.471700 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.requestlog [None req-0fcff536-914c-4478-913a-459e07cb843e admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002915 May 26 16:33:33.472303 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: [pid: 109793|app: 0|req: 16/33] 10.222.0.102 () {54 vars in 935 bytes} [Thu May 26 16:33:33 2022] GET /compute/v2.1 => generated 389 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:33:33.577922 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-696a65c4-aa56-4026-aecb-4287a5f582c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "id": "5", "ram": 16384, "swap": 0, "name": "m1.xlarge", "disk": 160}} {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:33:33.600423 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-696a65c4-aa56-4026-aecb-4287a5f582c5 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.61 time: 0.121500 May 26 16:33:33.601085 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 18/34] 10.222.0.102 () {64 vars in 1287 bytes} [Thu May 26 16:33:33 2022] POST /compute/v2.1/flavors => generated 410 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:33:33.616055 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-240265eb-21ef-4e99-9199-d4faea67d917 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:33:33.659624 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.requestlog [None req-240265eb-21ef-4e99-9199-d4faea67d917 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049341 May 26 16:33:33.660743 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: [pid: 109793|app: 0|req: 17/35] 10.222.0.102 () {64 vars in 1337 bytes} [Thu May 26 16:33:33 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:33:58.902528 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-696a65c4-aa56-4026-aecb-4287a5f582c5 admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:33:58.903548 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-696a65c4-aa56-4026-aecb-4287a5f582c5 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001453 May 26 16:33:58.903942 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 19/36] 10.222.0.102 () {54 vars in 935 bytes} [Thu May 26 16:33:58 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:33:58.915823 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG dbcounter [-] [109793] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=109793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:58.966112 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-8c1da1b2-61bc-435f-8c35-b79eee15a2fd admin admin] Calling method '>' {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:33:58.983657 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.requestlog [None req-8c1da1b2-61bc-435f-8c35-b79eee15a2fd admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4222 microversion: 2.61 time: 0.072354 May 26 16:33:58.984106 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: [pid: 109793|app: 0|req: 18/37] 10.222.0.102 () {60 vars in 1296 bytes} [Thu May 26 16:33:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4222 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:33:59.990981 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-696a65c4-aa56-4026-aecb-4287a5f582c5 admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:33:59.992358 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-696a65c4-aa56-4026-aecb-4287a5f582c5 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001858 May 26 16:33:59.992899 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 20/38] 10.222.0.102 () {56 vars in 1079 bytes} [Thu May 26 16:33:59 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:34:00.191238 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-03ab6ba0-b6be-4581-a315-baf8267fd008 admin admin] Calling method '>' {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:34:00.196957 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.wsgi [None req-03ab6ba0-b6be-4581-a315-baf8267fd008 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 16:34:00.200344 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-03ab6ba0-b6be-4581-a315-baf8267fd008 admin admin] Request method failure captured: May 26 16:34:00.200344 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 26 16:34:00.200344 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: Accept: application/json May 26 16:34:00.200344 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: Accept-Encoding: gzip, deflate May 26 16:34:00.200344 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: Connection: keep-alive May 26 16:34:00.200344 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: Content-Length: 0 May 26 16:34:00.200344 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: Host: 10.222.0.102 May 26 16:34:00.200344 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: Openstack-Api-Version: compute 2.90 May 26 16:34:00.200344 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: Openstack-System-Scope: None May 26 16:34:00.200344 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: User-Agent: python-novaclient May 26 16:34:00.200344 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Auth-Token: gAAAAABij6v3w7f-LYcd4Ki0cEIFc20BZIOQeXfWfsFSrRUZcdJH4Fxkk2w3V3t5d1gnxBNFjjjbioB570BiUSvKLpYVkWkeaSDUO8JpCnKuEN8yRgc85mu-bJ1GRdcap-OvySrSZWrYkBY1vYkQvBKruWTcmE_q-cVlkoLbqK56eOQagN6Xhzg May 26 16:34:00.200344 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Domain-Id: None May 26 16:34:00.200344 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Domain-Name: None May 26 16:34:00.200344 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Identity-Status: Confirmed May 26 16:34:00.200344 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Is-Admin-Project: True May 26 16:34:00.200344 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Openstack-Nova-Api-Version: 2.90 May 26 16:34:00.200344 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Project-Domain-Id: default May 26 16:34:00.200344 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Project-Domain-Name: Default May 26 16:34:00.200344 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Project-Id: 6d72a14f73b1482981ce0e1b7a09f3ea May 26 16:34:00.200344 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Project-Name: admin May 26 16:34:00.200344 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Role: member,reader,admin May 26 16:34:00.200344 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Roles: member,reader,admin May 26 16:34:00.202084 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/6d72a14f73b1482981ce0e1b7a09f3ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/6d72a14f73b1482981ce0e1b7a09f3ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/6d72a14f73b1482981ce0e1b7a09f3ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_6d72a14f73b1482981ce0e1b7a09f3ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:34:00.202084 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Tenant: admin May 26 16:34:00.202084 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Tenant-Id: 6d72a14f73b1482981ce0e1b7a09f3ea May 26 16:34:00.202084 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Tenant-Name: admin May 26 16:34:00.202084 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-User: admin May 26 16:34:00.202084 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-User-Domain-Id: default May 26 16:34:00.202084 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-User-Domain-Name: Default May 26 16:34:00.202084 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-User-Id: 6f387b0c9da64b528c02340c2727e0f6 May 26 16:34:00.202084 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-User-Name: admin May 26 16:34:00.202084 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: method: > May 26 16:34:00.202084 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: exception: Flavor 42 could not be found. May 26 16:34:00.202084 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: action_args: {'id': '42'} May 26 16:34:00.202084 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:34:00.202084 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:34:00.203398 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 16:34:00.203398 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 16:34:00.203398 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 16:34:00.203398 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 16:34:00.203398 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 16:34:00.203398 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 16:34:00.203398 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 16:34:00.203398 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 16:34:00.203398 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 16:34:00.203398 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:34:00.203398 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 16:34:00.203398 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 16:34:00.203398 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 26 16:34:00.203398 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi May 26 16:34:00.203398 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:34:00.203398 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi May 26 16:34:00.203398 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:34:00.203398 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:34:00.203398 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:34:00.205989 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:34:00.205989 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:34:00.205989 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:34:00.205989 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:34:00.205989 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 16:34:00.205989 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 16:34:00.205989 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 26 16:34:00.205989 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi May 26 16:34:00.205989 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:34:00.205989 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi May 26 16:34:00.205989 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:34:00.205989 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:34:00.205989 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:34:00.205989 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:34:00.205989 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:34:00.205989 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 26 16:34:00.205989 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi May 26 16:34:00.205989 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-03ab6ba0-b6be-4581-a315-baf8267fd008 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:34:00.207208 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.requestlog [None req-03ab6ba0-b6be-4581-a315-baf8267fd008 admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.066355 May 26 16:34:00.207208 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: [pid: 109793|app: 0|req: 19/39] 10.222.0.102 () {60 vars in 1195 bytes} [Thu May 26 16:34:00 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 16:34:00.213030 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-cc6d8513-60cd-4af9-ace8-03517103d03a admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:34:00.215888 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG dbcounter [-] [109792] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:00.235975 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-cc6d8513-60cd-4af9-ace8-03517103d03a admin admin] 10.222.0.102 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.026464 May 26 16:34:00.236578 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 21/40] 10.222.0.102 () {60 vars in 1215 bytes} [Thu May 26 16:34:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:34:00.247653 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-cf5f9971-49f3-4fb0-91b5-e0896c865a0e admin admin] Calling method '>' {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:34:00.270295 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.requestlog [None req-cf5f9971-49f3-4fb0-91b5-e0896c865a0e admin admin] 10.222.0.102 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.027094 May 26 16:34:00.270885 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: [pid: 109793|app: 0|req: 20/41] 10.222.0.102 () {60 vars in 1215 bytes} [Thu May 26 16:34:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:34:00.280554 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-b911803b-6581-4073-96c6-ef2cdb665769 admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:34:00.287145 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.wsgi [None req-b911803b-6581-4073-96c6-ef2cdb665769 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 16:34:00.290625 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-b911803b-6581-4073-96c6-ef2cdb665769 admin admin] Request method failure captured: May 26 16:34:00.290625 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 26 16:34:00.290625 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: Accept: application/json May 26 16:34:00.290625 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: Accept-Encoding: gzip, deflate May 26 16:34:00.290625 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: Connection: keep-alive May 26 16:34:00.290625 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: Content-Length: 0 May 26 16:34:00.290625 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: Host: 10.222.0.102 May 26 16:34:00.290625 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: Openstack-Api-Version: compute 2.90 May 26 16:34:00.290625 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: Openstack-System-Scope: None May 26 16:34:00.290625 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: User-Agent: python-novaclient May 26 16:34:00.290625 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Auth-Token: gAAAAABij6v3w7f-LYcd4Ki0cEIFc20BZIOQeXfWfsFSrRUZcdJH4Fxkk2w3V3t5d1gnxBNFjjjbioB570BiUSvKLpYVkWkeaSDUO8JpCnKuEN8yRgc85mu-bJ1GRdcap-OvySrSZWrYkBY1vYkQvBKruWTcmE_q-cVlkoLbqK56eOQagN6Xhzg May 26 16:34:00.290625 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Domain-Id: None May 26 16:34:00.290625 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Domain-Name: None May 26 16:34:00.290625 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Identity-Status: Confirmed May 26 16:34:00.290625 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Is-Admin-Project: True May 26 16:34:00.290625 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Openstack-Nova-Api-Version: 2.90 May 26 16:34:00.290625 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Project-Domain-Id: default May 26 16:34:00.290625 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Project-Domain-Name: Default May 26 16:34:00.290625 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Project-Id: 6d72a14f73b1482981ce0e1b7a09f3ea May 26 16:34:00.290625 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Project-Name: admin May 26 16:34:00.290625 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Role: member,reader,admin May 26 16:34:00.290625 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Roles: member,reader,admin May 26 16:34:00.292339 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/6d72a14f73b1482981ce0e1b7a09f3ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/6d72a14f73b1482981ce0e1b7a09f3ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/6d72a14f73b1482981ce0e1b7a09f3ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_6d72a14f73b1482981ce0e1b7a09f3ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:34:00.292339 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Tenant: admin May 26 16:34:00.292339 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Tenant-Id: 6d72a14f73b1482981ce0e1b7a09f3ea May 26 16:34:00.292339 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Tenant-Name: admin May 26 16:34:00.292339 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-User: admin May 26 16:34:00.292339 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-User-Domain-Id: default May 26 16:34:00.292339 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-User-Domain-Name: Default May 26 16:34:00.292339 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-User-Id: 6f387b0c9da64b528c02340c2727e0f6 May 26 16:34:00.292339 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-User-Name: admin May 26 16:34:00.292339 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: method: > May 26 16:34:00.292339 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: exception: Flavor 42 could not be found. May 26 16:34:00.292339 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: action_args: {'id': '42'} May 26 16:34:00.292339 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:34:00.292339 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:34:00.293748 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 16:34:00.293748 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 16:34:00.293748 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 16:34:00.293748 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 16:34:00.293748 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 16:34:00.293748 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 16:34:00.293748 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 16:34:00.293748 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 16:34:00.293748 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 16:34:00.293748 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:34:00.293748 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 16:34:00.293748 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 16:34:00.293748 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 26 16:34:00.293748 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi May 26 16:34:00.293748 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:34:00.293748 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi May 26 16:34:00.293748 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:34:00.293748 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:34:00.293748 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:34:00.294949 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:34:00.294949 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:34:00.294949 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:34:00.294949 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:34:00.294949 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 16:34:00.294949 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 16:34:00.294949 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 26 16:34:00.294949 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi May 26 16:34:00.294949 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:34:00.294949 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi May 26 16:34:00.294949 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:34:00.294949 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:34:00.294949 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:34:00.294949 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:34:00.294949 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:34:00.294949 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 26 16:34:00.294949 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi May 26 16:34:00.294949 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-b911803b-6581-4073-96c6-ef2cdb665769 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:34:00.295924 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-b911803b-6581-4073-96c6-ef2cdb665769 admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015189 May 26 16:34:00.295924 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 22/42] 10.222.0.102 () {60 vars in 1195 bytes} [Thu May 26 16:34:00 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 26 16:34:01.182130 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-cf5f9971-49f3-4fb0-91b5-e0896c865a0e admin admin] Calling method '>' {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:34:01.183189 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.requestlog [None req-cf5f9971-49f3-4fb0-91b5-e0896c865a0e admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001497 May 26 16:34:01.183589 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: [pid: 109793|app: 0|req: 21/43] 10.222.0.102 () {56 vars in 1079 bytes} [Thu May 26 16:34:01 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:34:01.379267 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-f2fa93a7-1657-402f-8fca-0d03d66bc082 admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:34:01.385301 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.wsgi [None req-f2fa93a7-1657-402f-8fca-0d03d66bc082 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 16:34:01.386833 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-f2fa93a7-1657-402f-8fca-0d03d66bc082 admin admin] Request method failure captured: May 26 16:34:01.386833 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 26 16:34:01.386833 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: Accept: application/json May 26 16:34:01.386833 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: Accept-Encoding: gzip, deflate May 26 16:34:01.386833 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: Connection: keep-alive May 26 16:34:01.386833 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: Content-Length: 0 May 26 16:34:01.386833 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: Host: 10.222.0.102 May 26 16:34:01.386833 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: Openstack-Api-Version: compute 2.90 May 26 16:34:01.386833 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: Openstack-System-Scope: None May 26 16:34:01.386833 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: User-Agent: python-novaclient May 26 16:34:01.386833 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Auth-Token: gAAAAABij6v52el00pMHpJVJST5OcPDN6M3ToNe5hFZ058bpc7nzXyKMGkc3y4KadPZrDDcRiAjPTnfZuPs-iteyxrL7d29BQHkBsMZWwt8URrGL3cdbTQKJaZz65hCIgJEW0G9fV7ggrm-78f7y2QJXvIe53okaxESgMRnq8DAQ7ubHpbkEQI4 May 26 16:34:01.386833 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Domain-Id: None May 26 16:34:01.386833 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Domain-Name: None May 26 16:34:01.386833 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Identity-Status: Confirmed May 26 16:34:01.386833 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Is-Admin-Project: True May 26 16:34:01.386833 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Openstack-Nova-Api-Version: 2.90 May 26 16:34:01.386833 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Project-Domain-Id: default May 26 16:34:01.386833 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Project-Domain-Name: Default May 26 16:34:01.386833 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Project-Id: 6d72a14f73b1482981ce0e1b7a09f3ea May 26 16:34:01.386833 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Project-Name: admin May 26 16:34:01.386833 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Role: member,reader,admin May 26 16:34:01.386833 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Roles: member,reader,admin May 26 16:34:01.388405 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/6d72a14f73b1482981ce0e1b7a09f3ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/6d72a14f73b1482981ce0e1b7a09f3ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/6d72a14f73b1482981ce0e1b7a09f3ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_6d72a14f73b1482981ce0e1b7a09f3ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:34:01.388405 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Tenant: admin May 26 16:34:01.388405 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Tenant-Id: 6d72a14f73b1482981ce0e1b7a09f3ea May 26 16:34:01.388405 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Tenant-Name: admin May 26 16:34:01.388405 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-User: admin May 26 16:34:01.388405 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-User-Domain-Id: default May 26 16:34:01.388405 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-User-Domain-Name: Default May 26 16:34:01.388405 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-User-Id: 6f387b0c9da64b528c02340c2727e0f6 May 26 16:34:01.388405 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-User-Name: admin May 26 16:34:01.388405 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: method: > May 26 16:34:01.388405 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: exception: Flavor 84 could not be found. May 26 16:34:01.388405 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: action_args: {'id': '84'} May 26 16:34:01.388405 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:34:01.388405 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:34:01.389303 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 16:34:01.389303 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 16:34:01.389303 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 16:34:01.389303 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 16:34:01.389303 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 16:34:01.389303 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 16:34:01.389303 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 16:34:01.389303 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 16:34:01.389303 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 16:34:01.389303 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:34:01.389303 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 16:34:01.389303 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 16:34:01.389303 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 26 16:34:01.389303 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi May 26 16:34:01.389303 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:34:01.389303 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi May 26 16:34:01.389303 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:34:01.389303 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:34:01.389303 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:34:01.390779 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:34:01.390779 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:34:01.390779 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:34:01.390779 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:34:01.390779 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 16:34:01.390779 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 16:34:01.390779 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 26 16:34:01.390779 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi May 26 16:34:01.390779 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:34:01.390779 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi May 26 16:34:01.390779 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:34:01.390779 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:34:01.390779 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:34:01.390779 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:34:01.390779 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:34:01.390779 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 26 16:34:01.390779 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi May 26 16:34:01.390779 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-f2fa93a7-1657-402f-8fca-0d03d66bc082 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:34:01.391992 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-f2fa93a7-1657-402f-8fca-0d03d66bc082 admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.065135 May 26 16:34:01.391992 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 23/44] 10.222.0.102 () {60 vars in 1195 bytes} [Thu May 26 16:34:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 16:34:01.398253 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-52387699-4305-494b-a5bf-4a2de2b0ff57 admin admin] Calling method '>' {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:34:01.414084 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.requestlog [None req-52387699-4305-494b-a5bf-4a2de2b0ff57 admin admin] 10.222.0.102 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.019391 May 26 16:34:01.414652 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: [pid: 109793|app: 0|req: 22/45] 10.222.0.102 () {60 vars in 1215 bytes} [Thu May 26 16:34:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:34:01.425356 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-dd7b99e4-dae7-4f38-ab90-1a3f94c0f16a admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:34:01.440617 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-dd7b99e4-dae7-4f38-ab90-1a3f94c0f16a admin admin] 10.222.0.102 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.018720 May 26 16:34:01.441200 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 24/46] 10.222.0.102 () {60 vars in 1215 bytes} [Thu May 26 16:34:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:34:01.452290 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-f7f30f34-7496-4b35-9a90-7b4a0b515fc7 admin admin] Calling method '>' {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:34:01.457863 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.wsgi [None req-f7f30f34-7496-4b35-9a90-7b4a0b515fc7 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 16:34:01.459386 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-f7f30f34-7496-4b35-9a90-7b4a0b515fc7 admin admin] Request method failure captured: May 26 16:34:01.459386 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 26 16:34:01.459386 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: Accept: application/json May 26 16:34:01.459386 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: Accept-Encoding: gzip, deflate May 26 16:34:01.459386 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: Connection: keep-alive May 26 16:34:01.459386 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: Content-Length: 0 May 26 16:34:01.459386 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: Host: 10.222.0.102 May 26 16:34:01.459386 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: Openstack-Api-Version: compute 2.90 May 26 16:34:01.459386 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: Openstack-System-Scope: None May 26 16:34:01.459386 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: User-Agent: python-novaclient May 26 16:34:01.459386 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Auth-Token: gAAAAABij6v52el00pMHpJVJST5OcPDN6M3ToNe5hFZ058bpc7nzXyKMGkc3y4KadPZrDDcRiAjPTnfZuPs-iteyxrL7d29BQHkBsMZWwt8URrGL3cdbTQKJaZz65hCIgJEW0G9fV7ggrm-78f7y2QJXvIe53okaxESgMRnq8DAQ7ubHpbkEQI4 May 26 16:34:01.459386 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Domain-Id: None May 26 16:34:01.459386 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Domain-Name: None May 26 16:34:01.459386 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Identity-Status: Confirmed May 26 16:34:01.459386 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Is-Admin-Project: True May 26 16:34:01.459386 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Openstack-Nova-Api-Version: 2.90 May 26 16:34:01.459386 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Project-Domain-Id: default May 26 16:34:01.459386 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Project-Domain-Name: Default May 26 16:34:01.459386 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Project-Id: 6d72a14f73b1482981ce0e1b7a09f3ea May 26 16:34:01.459386 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Project-Name: admin May 26 16:34:01.459386 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Role: member,reader,admin May 26 16:34:01.459386 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Roles: member,reader,admin May 26 16:34:01.460949 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/6d72a14f73b1482981ce0e1b7a09f3ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/6d72a14f73b1482981ce0e1b7a09f3ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/6d72a14f73b1482981ce0e1b7a09f3ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_6d72a14f73b1482981ce0e1b7a09f3ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:34:01.460949 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Tenant: admin May 26 16:34:01.460949 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Tenant-Id: 6d72a14f73b1482981ce0e1b7a09f3ea May 26 16:34:01.460949 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Tenant-Name: admin May 26 16:34:01.460949 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-User: admin May 26 16:34:01.460949 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-User-Domain-Id: default May 26 16:34:01.460949 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-User-Domain-Name: Default May 26 16:34:01.460949 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-User-Id: 6f387b0c9da64b528c02340c2727e0f6 May 26 16:34:01.460949 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-User-Name: admin May 26 16:34:01.460949 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: method: > May 26 16:34:01.460949 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: exception: Flavor 84 could not be found. May 26 16:34:01.460949 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: action_args: {'id': '84'} May 26 16:34:01.460949 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:34:01.460949 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:34:01.461916 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 16:34:01.461916 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 16:34:01.461916 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 16:34:01.461916 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 16:34:01.461916 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 16:34:01.461916 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 16:34:01.461916 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 16:34:01.461916 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 16:34:01.461916 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 16:34:01.461916 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:34:01.461916 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 16:34:01.461916 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 16:34:01.461916 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 26 16:34:01.461916 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi May 26 16:34:01.461916 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:34:01.461916 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi May 26 16:34:01.461916 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:34:01.461916 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:34:01.461916 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:34:01.463495 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:34:01.463495 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:34:01.463495 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:34:01.463495 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:34:01.463495 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 16:34:01.463495 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 16:34:01.463495 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 26 16:34:01.463495 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi May 26 16:34:01.463495 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:34:01.463495 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi May 26 16:34:01.463495 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:34:01.463495 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:34:01.463495 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:34:01.463495 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:34:01.463495 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:34:01.463495 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 26 16:34:01.463495 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi May 26 16:34:01.463495 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-f7f30f34-7496-4b35-9a90-7b4a0b515fc7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:34:01.464762 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.requestlog [None req-f7f30f34-7496-4b35-9a90-7b4a0b515fc7 admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012088 May 26 16:34:01.464762 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: [pid: 109793|app: 0|req: 23/47] 10.222.0.102 () {60 vars in 1195 bytes} [Thu May 26 16:34:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 16:34:02.353593 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-dd7b99e4-dae7-4f38-ab90-1a3f94c0f16a admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:34:02.354606 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-dd7b99e4-dae7-4f38-ab90-1a3f94c0f16a admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001441 May 26 16:34:02.355006 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 25/48] 10.222.0.102 () {56 vars in 1079 bytes} [Thu May 26 16:34:02 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:34:02.565427 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-3336515b-682b-4d0f-8090-7ba54c8fe61b admin admin] Calling method '>' {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:34:02.576303 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.wsgi [None req-3336515b-682b-4d0f-8090-7ba54c8fe61b admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 16:34:02.579394 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-3336515b-682b-4d0f-8090-7ba54c8fe61b admin admin] Request method failure captured: May 26 16:34:02.579394 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 26 16:34:02.579394 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: Accept: application/json May 26 16:34:02.579394 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: Accept-Encoding: gzip, deflate May 26 16:34:02.579394 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: Connection: keep-alive May 26 16:34:02.579394 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: Content-Length: 0 May 26 16:34:02.579394 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: Host: 10.222.0.102 May 26 16:34:02.579394 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: Openstack-Api-Version: compute 2.90 May 26 16:34:02.579394 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: Openstack-System-Scope: None May 26 16:34:02.579394 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: User-Agent: python-novaclient May 26 16:34:02.579394 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Auth-Token: gAAAAABij6v6GShcf4qLQjvcyTTPoVdcVwDmE1s2WmC--Y8JeC7yqXx3e8s4OA8jpJjR7_5sUa87ei2MP6pB8j0xKJGYqNoTTJziwWP3wCUEMe9CWRee3adPmYBIyqgE9SYyZonJ7jV4wWVFjj_q7cFt0J8yVHtlmAY7ZLznuoSG4QAz0vYFcTs May 26 16:34:02.579394 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Domain-Id: None May 26 16:34:02.579394 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Domain-Name: None May 26 16:34:02.579394 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Identity-Status: Confirmed May 26 16:34:02.579394 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Is-Admin-Project: True May 26 16:34:02.579394 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Openstack-Nova-Api-Version: 2.90 May 26 16:34:02.579394 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Project-Domain-Id: default May 26 16:34:02.579394 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Project-Domain-Name: Default May 26 16:34:02.579394 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Project-Id: 6d72a14f73b1482981ce0e1b7a09f3ea May 26 16:34:02.579394 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Project-Name: admin May 26 16:34:02.579394 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Role: member,reader,admin May 26 16:34:02.579394 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Roles: member,reader,admin May 26 16:34:02.581002 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/6d72a14f73b1482981ce0e1b7a09f3ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/6d72a14f73b1482981ce0e1b7a09f3ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/6d72a14f73b1482981ce0e1b7a09f3ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_6d72a14f73b1482981ce0e1b7a09f3ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:34:02.581002 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Tenant: admin May 26 16:34:02.581002 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Tenant-Id: 6d72a14f73b1482981ce0e1b7a09f3ea May 26 16:34:02.581002 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-Tenant-Name: admin May 26 16:34:02.581002 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-User: admin May 26 16:34:02.581002 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-User-Domain-Id: default May 26 16:34:02.581002 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-User-Domain-Name: Default May 26 16:34:02.581002 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-User-Id: 6f387b0c9da64b528c02340c2727e0f6 May 26 16:34:02.581002 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: X-User-Name: admin May 26 16:34:02.581002 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: method: > May 26 16:34:02.581002 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: exception: Flavor 451 could not be found. May 26 16:34:02.581002 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: action_args: {'id': '451'} May 26 16:34:02.581002 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:34:02.581002 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:34:02.581855 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 16:34:02.581855 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 16:34:02.581855 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 16:34:02.581855 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 16:34:02.581855 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 16:34:02.581855 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 16:34:02.581855 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 16:34:02.581855 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 16:34:02.581855 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 16:34:02.581855 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:34:02.581855 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 16:34:02.581855 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 16:34:02.581855 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 26 16:34:02.581855 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi May 26 16:34:02.581855 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:34:02.581855 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi May 26 16:34:02.581855 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:34:02.581855 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:34:02.581855 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:34:02.582999 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:34:02.582999 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:34:02.582999 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:34:02.582999 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:34:02.582999 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 16:34:02.582999 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 16:34:02.582999 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 26 16:34:02.582999 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi May 26 16:34:02.582999 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:34:02.582999 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi May 26 16:34:02.582999 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:34:02.582999 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:34:02.582999 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:34:02.582999 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:34:02.582999 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:34:02.582999 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 26 16:34:02.582999 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: ERROR nova.api.openstack.wsgi May 26 16:34:02.582999 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-3336515b-682b-4d0f-8090-7ba54c8fe61b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:34:02.584026 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.requestlog [None req-3336515b-682b-4d0f-8090-7ba54c8fe61b admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.077743 May 26 16:34:02.584026 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: [pid: 109793|app: 0|req: 24/49] 10.222.0.102 () {60 vars in 1198 bytes} [Thu May 26 16:34:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 26 16:34:02.598050 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-91b43dd3-8449-414d-a54d-14ccf4e0108e admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:34:02.615174 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-91b43dd3-8449-414d-a54d-14ccf4e0108e admin admin] 10.222.0.102 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.022475 May 26 16:34:02.615751 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 26/50] 10.222.0.102 () {60 vars in 1215 bytes} [Thu May 26 16:34:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:34:02.625624 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-cd97e164-d36c-4c13-9f95-dc0da1338285 admin admin] Calling method '>' {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:34:02.640403 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.requestlog [None req-cd97e164-d36c-4c13-9f95-dc0da1338285 admin admin] 10.222.0.102 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.018252 May 26 16:34:02.640970 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: [pid: 109793|app: 0|req: 25/51] 10.222.0.102 () {60 vars in 1215 bytes} [Thu May 26 16:34:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:34:02.651357 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-7ee53904-da1f-4689-892a-82a182dcd9cc admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:34:02.657296 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.wsgi [None req-7ee53904-da1f-4689-892a-82a182dcd9cc admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 16:34:02.658846 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-7ee53904-da1f-4689-892a-82a182dcd9cc admin admin] Request method failure captured: May 26 16:34:02.658846 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 26 16:34:02.658846 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: Accept: application/json May 26 16:34:02.658846 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: Accept-Encoding: gzip, deflate May 26 16:34:02.658846 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: Connection: keep-alive May 26 16:34:02.658846 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: Content-Length: 0 May 26 16:34:02.658846 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: Host: 10.222.0.102 May 26 16:34:02.658846 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: Openstack-Api-Version: compute 2.90 May 26 16:34:02.658846 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: Openstack-System-Scope: None May 26 16:34:02.658846 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: User-Agent: python-novaclient May 26 16:34:02.658846 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Auth-Token: gAAAAABij6v6GShcf4qLQjvcyTTPoVdcVwDmE1s2WmC--Y8JeC7yqXx3e8s4OA8jpJjR7_5sUa87ei2MP6pB8j0xKJGYqNoTTJziwWP3wCUEMe9CWRee3adPmYBIyqgE9SYyZonJ7jV4wWVFjj_q7cFt0J8yVHtlmAY7ZLznuoSG4QAz0vYFcTs May 26 16:34:02.658846 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Domain-Id: None May 26 16:34:02.658846 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Domain-Name: None May 26 16:34:02.658846 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Identity-Status: Confirmed May 26 16:34:02.658846 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Is-Admin-Project: True May 26 16:34:02.658846 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Openstack-Nova-Api-Version: 2.90 May 26 16:34:02.658846 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Project-Domain-Id: default May 26 16:34:02.658846 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Project-Domain-Name: Default May 26 16:34:02.658846 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Project-Id: 6d72a14f73b1482981ce0e1b7a09f3ea May 26 16:34:02.658846 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Project-Name: admin May 26 16:34:02.658846 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Role: member,reader,admin May 26 16:34:02.658846 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Roles: member,reader,admin May 26 16:34:02.661388 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/6d72a14f73b1482981ce0e1b7a09f3ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/6d72a14f73b1482981ce0e1b7a09f3ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/6d72a14f73b1482981ce0e1b7a09f3ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_6d72a14f73b1482981ce0e1b7a09f3ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:34:02.661388 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Tenant: admin May 26 16:34:02.661388 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Tenant-Id: 6d72a14f73b1482981ce0e1b7a09f3ea May 26 16:34:02.661388 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-Tenant-Name: admin May 26 16:34:02.661388 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-User: admin May 26 16:34:02.661388 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-User-Domain-Id: default May 26 16:34:02.661388 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-User-Domain-Name: Default May 26 16:34:02.661388 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-User-Id: 6f387b0c9da64b528c02340c2727e0f6 May 26 16:34:02.661388 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: X-User-Name: admin May 26 16:34:02.661388 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: method: > May 26 16:34:02.661388 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: exception: Flavor 451 could not be found. May 26 16:34:02.661388 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: action_args: {'id': '451'} May 26 16:34:02.661388 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:34:02.661388 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:34:02.663250 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 16:34:02.663250 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 16:34:02.663250 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 16:34:02.663250 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 16:34:02.663250 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 16:34:02.663250 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 16:34:02.663250 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 16:34:02.663250 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 16:34:02.663250 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 16:34:02.663250 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:34:02.663250 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 16:34:02.663250 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 16:34:02.663250 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 26 16:34:02.663250 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi May 26 16:34:02.663250 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:34:02.663250 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi May 26 16:34:02.663250 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:34:02.663250 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:34:02.663250 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:34:02.665645 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:34:02.665645 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:34:02.665645 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:34:02.665645 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:34:02.665645 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 16:34:02.665645 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 16:34:02.665645 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 26 16:34:02.665645 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi May 26 16:34:02.665645 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:34:02.665645 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi May 26 16:34:02.665645 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:34:02.665645 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:34:02.665645 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:34:02.665645 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:34:02.665645 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:34:02.665645 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 26 16:34:02.665645 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi May 26 16:34:02.665645 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-7ee53904-da1f-4689-892a-82a182dcd9cc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:34:02.667866 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-7ee53904-da1f-4689-892a-82a182dcd9cc admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012708 May 26 16:34:02.667866 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 27/52] 10.222.0.102 () {60 vars in 1198 bytes} [Thu May 26 16:34:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 16:34:03.559841 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-cd97e164-d36c-4c13-9f95-dc0da1338285 admin admin] Calling method '>' {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:34:03.561178 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.requestlog [None req-cd97e164-d36c-4c13-9f95-dc0da1338285 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001803 May 26 16:34:03.561657 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: [pid: 109793|app: 0|req: 26/53] 10.222.0.102 () {56 vars in 1079 bytes} [Thu May 26 16:34:03 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:34:03.782609 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-244dc6e7-b617-4481-b009-74785fd25cc1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:34:03.829614 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-244dc6e7-b617-4481-b009-74785fd25cc1 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.90 time: 0.125892 May 26 16:34:03.830685 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 28/54] 10.222.0.102 () {64 vars in 1240 bytes} [Thu May 26 16:34:03 2022] POST /compute/v2.1/flavors => generated 406 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:34:04.751686 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-cd97e164-d36c-4c13-9f95-dc0da1338285 admin admin] Calling method '>' {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:34:04.753356 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.requestlog [None req-cd97e164-d36c-4c13-9f95-dc0da1338285 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002115 May 26 16:34:04.753767 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: [pid: 109793|app: 0|req: 27/55] 10.222.0.102 () {56 vars in 1079 bytes} [Thu May 26 16:34:04 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:34:04.947501 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-e81d4d22-b0c7-49f0-bb18-fbd5c37dfbf9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:34:04.966072 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-e81d4d22-b0c7-49f0-bb18-fbd5c37dfbf9 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.073808 May 26 16:34:04.966632 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 29/56] 10.222.0.102 () {64 vars in 1240 bytes} [Thu May 26 16:34:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:34:05.850900 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-cd97e164-d36c-4c13-9f95-dc0da1338285 admin admin] Calling method '>' {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:34:05.852235 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.requestlog [None req-cd97e164-d36c-4c13-9f95-dc0da1338285 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001771 May 26 16:34:05.852816 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: [pid: 109793|app: 0|req: 28/57] 10.222.0.102 () {56 vars in 1079 bytes} [Thu May 26 16:34:05 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:34:06.046338 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-41a3c9cb-1123-4184-84d2-f0f13618cc70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:34:06.065899 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-41a3c9cb-1123-4184-84d2-f0f13618cc70 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.072278 May 26 16:34:06.066376 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 30/58] 10.222.0.102 () {64 vars in 1240 bytes} [Thu May 26 16:34:05 2022] POST /compute/v2.1/flavors => generated 409 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:34:06.954478 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-cd97e164-d36c-4c13-9f95-dc0da1338285 admin admin] Calling method '>' {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:34:06.956033 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.requestlog [None req-cd97e164-d36c-4c13-9f95-dc0da1338285 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001434 May 26 16:34:06.956464 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: [pid: 109793|app: 0|req: 29/59] 10.222.0.102 () {56 vars in 1079 bytes} [Thu May 26 16:34:06 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:34:07.174674 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-bff9cd9d-c565-4c6a-a63b-39a9a76924da admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:34:07.194742 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-bff9cd9d-c565-4c6a-a63b-39a9a76924da admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.90 time: 0.075123 May 26 16:34:07.195307 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 31/60] 10.222.0.102 () {64 vars in 1240 bytes} [Thu May 26 16:34:07 2022] POST /compute/v2.1/flavors => generated 411 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:34:08.100405 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-cd97e164-d36c-4c13-9f95-dc0da1338285 admin admin] Calling method '>' {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:34:08.101419 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.requestlog [None req-cd97e164-d36c-4c13-9f95-dc0da1338285 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001459 May 26 16:34:08.101818 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: [pid: 109793|app: 0|req: 30/61] 10.222.0.102 () {56 vars in 1079 bytes} [Thu May 26 16:34:08 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:34:08.296014 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-fd50d74e-93cb-4122-a4d0-694dac7680a0 admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:34:08.317163 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-fd50d74e-93cb-4122-a4d0-694dac7680a0 admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/detail" status: 200 len: 5805 microversion: 2.90 time: 0.076550 May 26 16:34:08.317724 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 32/62] 10.222.0.102 () {60 vars in 1207 bytes} [Thu May 26 16:34:08 2022] GET /compute/v2.1/flavors/detail => generated 5805 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:35:11.108999 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-cd97e164-d36c-4c13-9f95-dc0da1338285 admin admin] Calling method '>' {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:35:11.110013 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.requestlog [None req-cd97e164-d36c-4c13-9f95-dc0da1338285 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001485 May 26 16:35:11.110417 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: [pid: 109793|app: 0|req: 31/63] 10.222.0.102 () {54 vars in 935 bytes} [Thu May 26 16:35:11 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:35:11.118050 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG dbcounter [-] [109792] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:11.170476 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-93339f8a-5fc7-49da-9b79-e7d0982633b5 admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:35:11.189752 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-93339f8a-5fc7-49da-9b79-e7d0982633b5 admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5819 microversion: 2.61 time: 0.072685 May 26 16:35:11.190109 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 33/64] 10.222.0.102 () {60 vars in 1296 bytes} [Thu May 26 16:35:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5819 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:35:11.211476 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG dbcounter [-] [109793] Writing DB stats nova_api:SELECT=14 {{(pid=109793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:11.215680 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-a6f9a816-9cfa-4451-9128-ff6372079bde admin admin] Calling method '>' {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:35:11.223961 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.requestlog [None req-a6f9a816-9cfa-4451-9128-ff6372079bde admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014019 May 26 16:35:11.224540 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: [pid: 109793|app: 0|req: 32/65] 10.222.0.102 () {60 vars in 1287 bytes} [Thu May 26 16:35:11 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:35:11.236167 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-587a00ee-087c-4e12-bc41-05fed3a19dbb admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:35:11.245401 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-587a00ee-087c-4e12-bc41-05fed3a19dbb admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011292 May 26 16:35:11.245965 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 34/66] 10.222.0.102 () {60 vars in 1290 bytes} [Thu May 26 16:35:11 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:35:11.257567 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-29b16da1-44af-4b15-8b58-f7d7f613bf7c admin admin] Calling method '>' {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:35:11.265416 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.requestlog [None req-29b16da1-44af-4b15-8b58-f7d7f613bf7c admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011450 May 26 16:35:11.265949 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: [pid: 109793|app: 0|req: 33/67] 10.222.0.102 () {60 vars in 1290 bytes} [Thu May 26 16:35:11 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:35:11.279555 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-6fe44a27-837b-45cc-a77f-28d746edd483 admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:35:11.288017 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-6fe44a27-837b-45cc-a77f-28d746edd483 admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012057 May 26 16:35:11.288591 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 35/68] 10.222.0.102 () {60 vars in 1287 bytes} [Thu May 26 16:35:11 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:38:51.652163 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-29b16da1-44af-4b15-8b58-f7d7f613bf7c admin admin] Calling method '>' {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:38:51.653208 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.requestlog [None req-29b16da1-44af-4b15-8b58-f7d7f613bf7c admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001464 May 26 16:38:51.653606 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: [pid: 109793|app: 0|req: 34/69] 10.222.0.102 () {56 vars in 1079 bytes} [Thu May 26 16:38:51 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:38:51.810210 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG dbcounter [-] [109792] Writing DB stats nova_api:SELECT=6 {{(pid=109792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:51.928498 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-e455994a-6bd8-44bc-8a59-17d3ac11c545 admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:38:51.929679 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:38:51.929679 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: warnings.warn(msg) May 26 16:38:51.930900 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-e455994a-6bd8-44bc-8a59-17d3ac11c545 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:38:51.931341 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-e455994a-6bd8-44bc-8a59-17d3ac11c545 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:38:51.932121 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-e455994a-6bd8-44bc-8a59-17d3ac11c545 admin admin] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:38:51.932583 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-e455994a-6bd8-44bc-8a59-17d3ac11c545 admin admin] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:38:51.965815 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-e455994a-6bd8-44bc-8a59-17d3ac11c545 admin admin] 10.222.0.102 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.157015 May 26 16:38:51.966380 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 36/70] 10.222.0.102 () {60 vars in 1198 bytes} [Thu May 26 16:38:51 2022] GET /compute/v2.1/os-services => generated 791 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:38:52.857797 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-29b16da1-44af-4b15-8b58-f7d7f613bf7c admin admin] Calling method '>' {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:38:52.858847 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.requestlog [None req-29b16da1-44af-4b15-8b58-f7d7f613bf7c admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001431 May 26 16:38:52.859250 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: [pid: 109793|app: 0|req: 35/71] 10.222.0.102 () {56 vars in 1079 bytes} [Thu May 26 16:38:52 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:38:53.070533 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-338f4f64-ce7d-4972-931b-91c149cf01cc admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:38:53.071637 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:38:53.071637 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: warnings.warn(msg) May 26 16:38:53.072856 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-338f4f64-ce7d-4972-931b-91c149cf01cc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:38:53.073307 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-338f4f64-ce7d-4972-931b-91c149cf01cc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:38:53.074104 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-338f4f64-ce7d-4972-931b-91c149cf01cc admin admin] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:38:53.074538 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-338f4f64-ce7d-4972-931b-91c149cf01cc admin admin] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:38:53.093954 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-338f4f64-ce7d-4972-931b-91c149cf01cc admin admin] 10.222.0.102 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077420 May 26 16:38:53.094548 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 37/72] 10.222.0.102 () {60 vars in 1198 bytes} [Thu May 26 16:38:53 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:39:04.369789 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-29b16da1-44af-4b15-8b58-f7d7f613bf7c admin admin] Calling method '>' {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:39:04.370873 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.requestlog [None req-29b16da1-44af-4b15-8b58-f7d7f613bf7c admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001501 May 26 16:39:04.371294 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: [pid: 109793|app: 0|req: 36/73] 10.222.0.102 () {56 vars in 1079 bytes} [Thu May 26 16:39:04 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:39:04.515431 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG dbcounter [-] [109792] Writing DB stats nova_cell0:SELECT=4 {{(pid=109792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:39:04.516151 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG dbcounter [-] [109792] Writing DB stats nova_cell1:SELECT=4 {{(pid=109792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:39:04.516909 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG dbcounter [-] [109792] Writing DB stats nova_api:SELECT=8 {{(pid=109792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:39:04.565574 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-edd111dc-c442-4860-b0a5-e70c7eefea91 admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:39:04.566720 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:39:04.566720 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: warnings.warn(msg) May 26 16:39:04.568332 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-edd111dc-c442-4860-b0a5-e70c7eefea91 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:39:04.568332 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-edd111dc-c442-4860-b0a5-e70c7eefea91 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:39:04.569137 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-edd111dc-c442-4860-b0a5-e70c7eefea91 admin admin] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:39:04.569563 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-edd111dc-c442-4860-b0a5-e70c7eefea91 admin admin] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:39:04.594958 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-edd111dc-c442-4860-b0a5-e70c7eefea91 admin admin] 10.222.0.102 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.083945 May 26 16:39:04.595519 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 38/74] 10.222.0.102 () {60 vars in 1198 bytes} [Thu May 26 16:39:04 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:39:05.473613 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: DEBUG nova.api.openstack.wsgi [None req-29b16da1-44af-4b15-8b58-f7d7f613bf7c admin admin] Calling method '>' {{(pid=109793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:39:05.474626 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: INFO nova.api.openstack.requestlog [None req-29b16da1-44af-4b15-8b58-f7d7f613bf7c admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001441 May 26 16:39:05.475031 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: [pid: 109793|app: 0|req: 37/75] 10.222.0.102 () {56 vars in 1079 bytes} [Thu May 26 16:39:05 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:39:05.664186 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-30df723f-ac2a-40c1-b105-78d83d23f1ee admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:39:05.665382 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:39:05.665382 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: warnings.warn(msg) May 26 16:39:05.666556 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-30df723f-ac2a-40c1-b105-78d83d23f1ee admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:39:05.667000 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-30df723f-ac2a-40c1-b105-78d83d23f1ee admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:39:05.667781 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-30df723f-ac2a-40c1-b105-78d83d23f1ee admin admin] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:39:05.668211 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-30df723f-ac2a-40c1-b105-78d83d23f1ee admin admin] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:39:05.691823 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-30df723f-ac2a-40c1-b105-78d83d23f1ee admin admin] 10.222.0.102 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078427 May 26 16:39:05.692420 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 39/76] 10.222.0.102 () {60 vars in 1198 bytes} [Thu May 26 16:39:05 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:40:09.783970 dv-cinder-836071-5-iscsi devstack@n-api.service[109791]: Thu May 26 16:40:09 2022 - graceful shutdown triggered... May 26 16:40:09.783864 dv-cinder-836071-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 26 16:40:09.785113 dv-cinder-836071-5-iscsi devstack@n-api.service[109792]: Gracefully killing worker 1 (pid: 109792)... May 26 16:40:09.785775 dv-cinder-836071-5-iscsi devstack@n-api.service[109793]: Gracefully killing worker 2 (pid: 109793)... May 26 16:40:10.784888 dv-cinder-836071-5-iscsi devstack@n-api.service[109791]: worker 1 buried after 1 seconds May 26 16:40:10.784888 dv-cinder-836071-5-iscsi devstack@n-api.service[109791]: worker 2 buried after 1 seconds May 26 16:40:10.784888 dv-cinder-836071-5-iscsi devstack@n-api.service[109791]: goodbye to uWSGI. May 26 16:40:10.786502 dv-cinder-836071-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 26 16:40:10.787607 dv-cinder-836071-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 26 16:40:10.790355 dv-cinder-836071-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 16:40:10.804874 dv-cinder-836071-5-iscsi devstack@n-api.service[124254]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 16:40:10.827750 dv-cinder-836071-5-iscsi devstack@n-api.service[124254]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 16:40:10 2022] *** May 26 16:40:10.827750 dv-cinder-836071-5-iscsi devstack@n-api.service[124254]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 16:40:10.827750 dv-cinder-836071-5-iscsi devstack@n-api.service[124254]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 16:40:10.827750 dv-cinder-836071-5-iscsi devstack@n-api.service[124254]: nodename: dv-cinder-836071-5-iscsi May 26 16:40:10.827750 dv-cinder-836071-5-iscsi devstack@n-api.service[124254]: machine: x86_64 May 26 16:40:10.827750 dv-cinder-836071-5-iscsi devstack@n-api.service[124254]: clock source: unix May 26 16:40:10.827750 dv-cinder-836071-5-iscsi devstack@n-api.service[124254]: pcre jit disabled May 26 16:40:10.827750 dv-cinder-836071-5-iscsi devstack@n-api.service[124254]: detected number of CPU cores: 4 May 26 16:40:10.827750 dv-cinder-836071-5-iscsi devstack@n-api.service[124254]: current working directory: / May 26 16:40:10.827750 dv-cinder-836071-5-iscsi devstack@n-api.service[124254]: detected binary path: /usr/bin/uwsgi-core May 26 16:40:10.827750 dv-cinder-836071-5-iscsi devstack@n-api.service[124254]: your processes number limit is 47680 May 26 16:40:10.827750 dv-cinder-836071-5-iscsi devstack@n-api.service[124254]: your memory page size is 4096 bytes May 26 16:40:10.827750 dv-cinder-836071-5-iscsi devstack@n-api.service[124254]: detected max file descriptor number: 2048 May 26 16:40:10.828775 dv-cinder-836071-5-iscsi devstack@n-api.service[124254]: lock engine: pthread robust mutexes May 26 16:40:10.828775 dv-cinder-836071-5-iscsi devstack@n-api.service[124254]: thunder lock: enabled May 26 16:40:10.828775 dv-cinder-836071-5-iscsi devstack@n-api.service[124254]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 16:40:10.828775 dv-cinder-836071-5-iscsi devstack@n-api.service[124254]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 16:40:10.875416 dv-cinder-836071-5-iscsi devstack@n-api.service[124254]: Python main interpreter initialized at 0x557fbcf0d9c0 May 26 16:40:10.875416 dv-cinder-836071-5-iscsi devstack@n-api.service[124254]: python threads support enabled May 26 16:40:10.875416 dv-cinder-836071-5-iscsi devstack@n-api.service[124254]: your server socket listen backlog is limited to 100 connections May 26 16:40:10.875416 dv-cinder-836071-5-iscsi devstack@n-api.service[124254]: your mercy for graceful operations on workers is 90 seconds May 26 16:40:10.875862 dv-cinder-836071-5-iscsi devstack@n-api.service[124254]: mapped 403077 bytes (393 KB) for 2 cores May 26 16:40:10.875862 dv-cinder-836071-5-iscsi devstack@n-api.service[124254]: *** Operational MODE: preforking *** May 26 16:40:10.876111 dv-cinder-836071-5-iscsi devstack@n-api.service[124254]: *** uWSGI is running in multiple interpreter mode *** May 26 16:40:10.876111 dv-cinder-836071-5-iscsi devstack@n-api.service[124254]: spawned uWSGI master process (pid: 124254) May 26 16:40:10.876323 dv-cinder-836071-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 16:40:10.876941 dv-cinder-836071-5-iscsi devstack@n-api.service[124254]: spawned uWSGI worker 1 (pid: 124266, cores: 1) May 26 16:40:10.880284 dv-cinder-836071-5-iscsi devstack@n-api.service[124254]: spawned uWSGI worker 2 (pid: 124267, cores: 1) May 26 16:40:10.880284 dv-cinder-836071-5-iscsi devstack@n-api.service[124254]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 16:40:12.063770 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 16:40:12.064617 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 16:40:12.864101 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:40:12.864101 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: from cryptography.utils import int_from_bytes May 26 16:40:12.864542 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:40:12.864542 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: from cryptography.utils import int_from_bytes May 26 16:40:12.884122 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:40:12.884122 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: from cryptography.utils import int_from_bytes May 26 16:40:12.884499 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:40:12.884499 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: from cryptography.utils import int_from_bytes May 26 16:40:15.293697 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 16:40:15.294307 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 16:40:15.294490 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 16:40:15.294946 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 16:40:15.298884 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 16:40:15.298884 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.298884 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.298884 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.298884 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.298884 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.298884 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.298884 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.299472 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.299472 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.299472 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.299472 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.299472 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836071-5-iscsi {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.299472 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.299871 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.299871 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.300173 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.300706 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.301040 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.301365 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.301878 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.302328 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.302674 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.302996 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.303386 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.303709 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.304027 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.304355 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.304693 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.305028 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.305352 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.305760 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836071-5-iscsi {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.306092 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.306415 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.306745 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.307160 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.307493 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.307821 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.308129 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.308487 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.308805 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.309138 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.309468 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.309812 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.310121 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.310431 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.310747 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.311064 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.311637 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.311955 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.312269 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.312894 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.312894 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.313174 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.313500 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.313830 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.314087 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.314340 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.314513 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 16:40:15.314919 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.315017 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 16:40:15.315112 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.315281 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.315382 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 16:40:15.315596 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.315689 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 16:40:15.315910 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.316006 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 16:40:15.316229 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.316324 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.316642 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.316734 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.316870 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.316971 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.317182 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.317286 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.317499 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.317608 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.317823 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.317972 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.318145 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.318288 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.318507 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.318601 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.318826 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.318926 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.319147 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.319250 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.319475 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.319573 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.102 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.319794 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.102 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.319896 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836071-5-iscsi {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.320108 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.320213 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.320464 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.320589 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.320765 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.320890 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.321087 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.321228 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.321533 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.321630 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.321715 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.321803 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.321999 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.322101 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.322335 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.322528 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.322690 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.322828 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.322960 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.323142 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.323290 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.323460 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.323601 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.323805 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.323905 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.324127 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.324231 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.324469 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.324577 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.324793 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.324927 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.325105 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.325200 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.325420 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.325622 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.325751 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.326151 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.326297 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.326432 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.326521 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836071-5-iscsi {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.326699 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.326832 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.326925 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.327008 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.327242 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.327370 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.327558 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.327701 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.327874 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.328191 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.328523 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.328638 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.328840 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.328949 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.329166 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.329280 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.329492 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.329597 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.329806 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.329902 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.330119 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.330221 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.330493 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.330700 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.330873 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.331056 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.331257 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.331417 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.331572 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.331718 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.331872 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.332024 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.332184 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.332339 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.332600 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.332757 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.332910 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.333053 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.333207 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.333372 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.333519 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.333675 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.334314 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.334480 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.334639 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.334783 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.334934 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.335083 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.335228 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.335388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.335538 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.335706 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.335858 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.336004 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.336156 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.336309 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.336489 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.336660 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.336815 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.336959 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.337117 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.337272 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.337416 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.337586 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.337741 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.337894 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.338051 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.338196 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.338340 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.338484 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.338634 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.338786 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.338941 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.339085 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.339230 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.339373 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.339542 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.339700 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.339864 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.340016 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.340172 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.340323 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.340521 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.340682 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.340835 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.102 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.340987 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.341133 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.102 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.341284 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.341437 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.341600 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.341752 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.341905 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.342057 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.342209 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.342360 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.342570 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.342724 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.342877 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.343022 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.343166 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.343322 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.343477 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.343622 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.343776 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.343927 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.344155 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.344322 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.344502 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.344649 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.344793 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.344937 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.345091 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.345253 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.345410 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.345570 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.345715 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.345859 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.346014 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.346174 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.346326 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.346478 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.346623 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.346775 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.346932 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.347122 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.347122 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.347400 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.347561 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.347705 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.347864 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.348023 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.348168 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.348321 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.348550 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.348696 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.348860 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.349005 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.349157 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.349319 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.349520 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.350188 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.350357 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.350516 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.350668 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.350826 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.350979 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.351136 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.351280 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.351432 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.351576 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.351727 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.351871 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.352034 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.352180 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.352324 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.352507 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.352653 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.352804 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.352948 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.353092 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.353246 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.353405 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.353551 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.353702 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.353846 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.354001 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.354001 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.354303 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.354459 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.354605 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.354748 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.354892 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.355036 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.355197 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.355342 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.355494 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.355645 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.355805 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.355974 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.356119 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.356277 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.356471 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.356623 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.356767 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.356922 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.357074 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.357228 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.357381 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.357525 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.357677 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.357839 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.358000 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.358152 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.358296 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.358447 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.358599 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.358744 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.358901 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.359057 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.359200 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.359351 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.359506 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.359658 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.359826 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.359972 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.360115 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.360268 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.360430 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.360590 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.360749 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.360905 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:40:15.361058 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.361209 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.361361 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.361515 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.361675 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.361838 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.361992 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.362136 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.362279 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.362440 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.362593 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.362745 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.362890 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.363045 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.363190 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.363343 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.363488 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.363652 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.363803 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.363956 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.364113 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.364276 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.364465 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.364628 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.364779 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.364933 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.365087 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.365241 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.365385 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.365529 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.365691 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.365836 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.366110 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.366267 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.366412 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.366562 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.366706 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.366859 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.367012 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.367159 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.367302 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.367453 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.367598 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.367761 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.367906 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.368059 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.368263 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.368441 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.368600 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.368826 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.368981 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.369126 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.369272 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.369272 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.369554 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.369708 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.369864 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.370016 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.370162 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.370315 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.370467 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.370625 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.370771 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.370923 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.371068 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.371220 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.371375 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.371520 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.371674 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.371818 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.371970 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.372122 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.372275 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.372457 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.372619 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.372765 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.372917 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.373061 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.373216 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.373369 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.373513 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.373675 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.373828 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.373979 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.374146 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.374303 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.374456 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.374608 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.374752 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.374908 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.375320 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.375483 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.375630 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.375784 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.375947 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.376100 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.376252 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.376425 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.376589 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.376741 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.376885 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.377038 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.377183 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.377335 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.377486 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.377638 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.377789 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.377957 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.378102 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.378253 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.378398 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.378548 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.378700 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.378854 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.378998 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.379149 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.379293 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.379437 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.379595 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.379742 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.379904 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.380056 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.380201 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.380344 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.380528 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.380674 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.380827 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.380972 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.381127 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.381278 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.381432 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.381585 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.381742 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.381886 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.382031 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.382174 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.382334 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.382479 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.382623 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.382774 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.382919 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.383077 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.383229 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.383381 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.383533 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.383694 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.383840 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.384004 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.384154 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.384306 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.384523 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.384669 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.384813 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.384971 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.385126 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.385278 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.385422 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.385566 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.385728 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.385886 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.386038 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.386190 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.386343 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.386495 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.386652 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.386796 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.386940 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.387092 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.387244 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.387395 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.387564 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.387884 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.388040 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.388186 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.388339 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.388511 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.388673 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.388826 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.388978 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.389166 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.389324 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.389476 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.389635 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.389795 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.389940 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.390091 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.390236 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.390236 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.390519 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.390671 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.390823 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.390968 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.391111 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.391265 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.391410 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.391562 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.391717 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.391870 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.392015 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.392167 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.392312 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.392511 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.392667 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.392812 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.392962 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.393119 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.393273 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.393418 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.393561 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.393722 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.393883 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.394034 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.394189 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.394189 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.394644 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.394838 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.395013 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.395160 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.395311 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.395458 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.395602 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.395753 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.395921 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.396067 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.396219 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.396955 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.397116 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.397261 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.397415 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.397568 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.397714 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.397865 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.398017 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.398169 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.398398 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.398556 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.398710 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.398861 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.399005 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.399159 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.399303 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.399303 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.399584 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.399728 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.399872 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.400025 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.400178 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.400332 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.400531 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.400690 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.400842 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.401001 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.401152 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.401297 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.401449 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.401593 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.401746 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.401903 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.402056 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.402201 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.402362 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.402513 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.402666 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.402812 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.402955 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.403099 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.403099 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.403377 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.403535 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.403686 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.403838 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.403995 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.404144 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.404298 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.404477 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.404625 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.404770 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.404915 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.405066 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.405210 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.405367 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.405512 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.405655 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.405799 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.405952 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.406105 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.406262 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.406414 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.406565 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.406723 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.406868 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.407020 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.407164 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.407308 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.407452 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.407608 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.407762 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.407906 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.408069 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.408213 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.408441 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.408598 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.408754 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.408899 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.409052 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.409202 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.409367 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.409526 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.409685 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.409837 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.409995 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.410158 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.410323 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.410474 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.410626 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.410776 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.410934 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.411085 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.411290 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.411450 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.411602 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.411761 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.411919 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.412688 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.412871 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.413032 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.413192 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.413344 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.413504 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.413669 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.413831 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.413997 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.414161 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.414321 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.414482 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.414643 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.414796 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.414965 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.415125 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.415285 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.415446 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.415606 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.415767 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.415919 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.416081 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.416232 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.416423 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.416584 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.416745 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.416915 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.417068 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.417219 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.417384 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.417537 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.417697 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.417856 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.418008 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.418158 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.418323 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.418482 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.418634 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.418785 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.418947 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.419113 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.419272 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.419432 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.419585 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.419735 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.419886 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.420045 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.420198 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.420349 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.420560 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.420723 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.420875 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.421046 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.421208 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.421367 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.421519 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.421685 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.421845 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.422046 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.422200 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.422359 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.422511 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.422663 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.422814 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.422979 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.423142 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.423301 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.423461 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.423620 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.423620 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.423928 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.424098 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.424250 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.424431 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.424597 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.424764 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.424917 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.425087 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.425248 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.425399 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.425550 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.425715 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.425715 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.426012 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.426162 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.426313 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.426472 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.426624 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.426774 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.426940 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.427116 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.427278 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.427430 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.427616 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.427783 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.427937 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.428172 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.428333 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.428587 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.428743 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.428894 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.429054 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.429220 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.429393 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.429553 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.429705 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.429864 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.430031 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.430190 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.430350 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.430510 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.430662 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.430821 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.430981 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.431134 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.431293 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.431823 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.431991 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.432146 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.432312 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.432542 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.432705 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.432872 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.433025 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.433178 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.433343 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.433496 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.433647 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.433810 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.433969 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.434140 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.434303 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.434462 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.434614 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.434766 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.434925 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.435091 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.435246 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.435407 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.435559 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.435710 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.435871 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.436349 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.436534 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.436687 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.436839 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.436990 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.437178 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.437349 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.437503 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.437653 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.437814 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.437967 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.438131 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.438313 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.438481 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.438634 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.438794 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.438953 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.439125 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.439286 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.439439 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.439590 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.439749 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.439900 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.440060 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.440060 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.440448 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.440621 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.440781 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.440941 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.441106 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.441265 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.441417 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.441569 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.441721 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.441886 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.442046 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.442206 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.442359 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.442521 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.442672 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.442833 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.442992 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.443184 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.443352 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.443516 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.443677 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.443844 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.444004 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.444218 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.444400 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.444570 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.444732 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.444901 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.445061 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.445221 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.445372 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.445524 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.445689 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.445851 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.446002 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.446161 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.446322 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.446482 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.446657 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.446818 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.446970 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.447122 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.447271 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.447423 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.447589 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.447742 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.447902 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.448068 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.448221 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.448398 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.448574 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.448738 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.448891 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.449050 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.449212 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.449373 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.449525 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.449676 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.449835 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.449995 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.450147 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.450308 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.450459 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.450619 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.450787 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.450941 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.451091 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.451257 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.451257 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.451554 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.451713 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.451872 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.452031 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.452196 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.452356 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.452578 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.452751 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.452904 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.453071 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.453261 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.453417 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.453576 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.453736 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.453896 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.454068 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.454222 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.454373 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.454539 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.454691 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.454853 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.455014 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.455167 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.455320 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.455470 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.455621 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.455771 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.455931 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.456091 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.456244 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.456421 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.456592 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.456753 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.456922 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.457074 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.457227 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.457385 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.457544 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.457708 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.457862 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.458021 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.458172 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.458324 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.458482 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.458691 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.459377 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.459553 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.459716 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.459876 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.460035 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.460197 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.460358 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.460537 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.460690 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.460842 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.461006 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.461159 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.461312 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.461475 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.461627 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.461777 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.461937 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.462090 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.462243 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.462394 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.462546 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.462546 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.462841 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.462841 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.463138 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.463138 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.463437 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.463591 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.463751 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.463903 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.464054 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.464214 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.464413 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.464594 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.464748 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.464908 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.465068 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.465227 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.465386 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.465561 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.465714 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.465865 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.466024 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.466175 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.466326 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.466556 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.466718 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.466878 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.467037 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.467189 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.467350 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.467528 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.467689 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.467842 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.468000 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.468152 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.468312 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.468510 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.468673 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.468827 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.468978 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.468978 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.469292 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.469452 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.469631 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.469631 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.469938 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.470099 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.470259 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.470411 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.470573 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.470726 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.470887 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.471040 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.471192 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.471350 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.471509 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.471679 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.471846 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.471846 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.472153 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.472314 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.472562 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.472717 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.472878 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.473031 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.473182 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.473340 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.473492 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.473651 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.473823 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.473983 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.474136 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.474294 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.474504 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.475183 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.475386 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.475386 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.475971 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.476139 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.476300 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.476512 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.476679 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.476839 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.476992 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.477152 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.477313 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.477313 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.477622 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.477783 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.477935 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.478087 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.478246 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.478411 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.478566 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.478729 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.478881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.479040 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.479205 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.479366 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.479366 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.479671 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.479823 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.479981 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.480146 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.480306 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.480524 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.480679 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.480853 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.481013 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.481175 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.481328 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.481480 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.481631 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.481790 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.481942 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.482102 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.482255 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.482407 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.482566 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.482725 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.482896 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.483056 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.483216 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.483377 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.483537 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.483690 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.483854 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.484007 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.484166 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.484325 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.484518 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.484673 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.484846 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.485001 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.485154 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.485306 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.485465 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.485627 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.485787 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.485939 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.486098 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.486197 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.486279 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.486418 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.486520 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.486614 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.486707 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.486792 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.486877 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.486968 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.487096 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.487222 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.487335 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.487445 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.487565 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.487565 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.487841 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.487841 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.487841 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.487841 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.488407 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.488528 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.488641 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.488765 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.488886 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.489005 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.489130 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.489249 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.489363 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.489474 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.489584 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.489700 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.489821 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.489932 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.490052 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.490209 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.490330 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.490441 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.490567 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.490679 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.490791 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.490902 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.491020 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.491140 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.491284 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.491415 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.491558 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.491688 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.491819 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.491958 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.492098 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.492225 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.492432 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.492583 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.492769 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.492892 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.493114 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.493243 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.493456 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.493585 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.493780 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.493902 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.494127 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.494256 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.494448 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.494575 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.494774 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.494985 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.495104 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.495224 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.495403 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.495525 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.495723 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.495847 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.496038 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.496158 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.496359 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.496550 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.496707 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.496834 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.497028 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.497150 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.497347 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.497479 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.497671 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.497793 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.497987 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.498115 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.498288 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.498453 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.498607 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.498908 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.499139 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.499342 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.499508 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.499669 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.499830 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.499991 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.500145 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.500443 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.500619 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.500882 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.501037 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.501037 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.501336 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.501336 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.501658 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.501904 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.502061 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.502214 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.502368 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.502529 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.502692 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.502854 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.503015 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.503238 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.503399 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.503561 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.503739 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.503901 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.504062 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.504215 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.504437 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.504614 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.504769 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.504922 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.505088 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.505088 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.505388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.505559 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.505756 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.505923 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.506077 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.506238 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.506391 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.506555 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.506709 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.506869 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.507030 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.507191 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.507353 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.508139 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.508313 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.508313 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.508672 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.508835 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.508998 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.509159 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.509312 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.509474 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.509627 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.509788 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.509954 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.510116 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.510269 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.510420 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.510583 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.510744 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.510911 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.511075 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.511236 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.511390 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.511550 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.511712 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.511867 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.512019 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.512178 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.512331 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.512523 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.512691 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.512847 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.512999 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.513159 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.513321 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.513475 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.513641 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.513794 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.513947 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.514107 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.514267 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.514434 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.514605 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.514759 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.514916 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.514916 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.515205 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.515366 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.515527 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.515688 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.515850 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.516007 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.516168 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.516334 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.516556 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.516556 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.516848 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.517012 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.517175 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.517328 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.517488 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.517641 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.517807 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.517960 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.518193 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.518350 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.518514 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.518675 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.518836 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.518996 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.519160 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.519313 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.519472 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.519624 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.519784 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.519936 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.520097 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.520258 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.520438 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.520617 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.520778 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.520946 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.521110 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.521264 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.522517 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.522694 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.522860 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.523023 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.523184 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.523339 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.523499 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.523652 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.523816 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.523984 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.524139 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.524300 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.524480 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.524635 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.524805 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.524966 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.525120 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.525274 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.525427 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.525580 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.525761 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.525927 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.526080 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.526233 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.526386 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.526547 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.526714 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.526869 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.527027 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.527188 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.527340 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.527508 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.527670 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.527836 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.527989 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.527989 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.528291 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.528494 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.528668 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.528829 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.529000 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.529162 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.529315 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.529477 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.529637 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.529812 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.529973 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.530126 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.530286 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.530452 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.530605 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.530766 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.530926 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.531087 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.531254 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.531407 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.531567 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.531729 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.531908 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.532062 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.532224 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.532407 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.532570 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.532723 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.532876 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.533029 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.533198 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.533198 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.533507 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.533662 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.533834 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.533995 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.534159 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.534312 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.534463 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.534623 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.534775 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.534938 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.535091 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.535243 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.535401 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.535563 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.535715 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.535900 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.536061 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.536214 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.536423 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.536587 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.536750 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.536914 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.537717 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.537922 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.538114 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.538303 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.538502 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.538693 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.538893 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.539092 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.539283 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.539480 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.539679 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.539883 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.540081 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.540271 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.540471 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.540655 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.540825 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.540987 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.541161 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.541900 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.542060 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.542224 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.542379 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.542540 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.542693 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.542855 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.543009 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.543169 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.543332 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.543485 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.543649 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.543849 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.544011 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.544164 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.544392 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.544563 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.544725 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.544725 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.545032 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.545032 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.545500 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.545655 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.545824 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.545994 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.546155 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.546309 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.546462 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.546615 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.546776 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.546938 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.547098 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.547259 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.547421 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.547421 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.547730 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.547884 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.548049 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.548209 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.548445 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.548620 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.548788 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.548950 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.549104 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.549256 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.549409 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.549571 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.549725 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.549878 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.550049 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.550211 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.550366 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.550603 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.550767 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.550920 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.551081 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.551241 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.551395 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.551560 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.551716 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.551716 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.552012 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.552177 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.552344 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.552344 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.552710 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.552874 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.553036 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.553196 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.553597 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.554012 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.554174 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.554328 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.554490 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.554664 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.554773 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.554868 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.554954 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.555046 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.555139 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.555236 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.555332 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.555419 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.555505 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.555597 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.555684 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.555785 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.555878 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.555971 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.556071 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.556165 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.556257 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.556352 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.556517 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.556642 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.556764 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.556879 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.556999 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.557126 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.557126 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.557126 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.557126 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.557518 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.557614 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.557700 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.557833 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.557935 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.558022 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.558106 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.558200 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.558292 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.558377 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.558468 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.558553 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.558644 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.558927 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.558927 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.559105 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.559190 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.559281 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.559380 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.559466 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.559557 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.559648 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.559733 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.559823 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.559916 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 16:40:15.560020 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.560020 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.560020 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.560276 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.560623 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.560983 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.561522 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.561842 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.562160 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.562477 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.562792 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.563112 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.563427 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.563743 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.564064 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.564409 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.564707 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.565024 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.565349 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.565662 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.565977 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.566292 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.566611 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.566924 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.567264 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.567606 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.567931 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.568816 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.569145 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.569477 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.569795 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.570124 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.570456 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.570784 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.571104 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.571446 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.571767 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.572090 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.572452 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.572779 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.573099 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.573419 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.573756 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.574093 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.574409 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.574747 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.575081 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.575415 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.575743 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.576068 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.576430 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.576760 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.577085 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.577413 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.577735 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.578058 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.578386 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.578712 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.579049 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.579385 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.579708 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.580046 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.580463 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.580764 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.581092 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.581449 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.581791 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.582119 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.582444 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.582760 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:40:15.583010 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 16:40:15.620237 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO dbcounter [None req-bf378ba9-0a8a-4721-9dca-b90c47c7cb7a None None] Registered counter for database nova_api May 26 16:40:15.641159 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_db.sqlalchemy.engines [None req-bf378ba9-0a8a-4721-9dca-b90c47c7cb7a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:40:15.644857 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO dbcounter [None req-e60a9c15-b16c-4b8d-a6ab-a945cd968b42 None None] Registered counter for database nova_api May 26 16:40:15.649269 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writer thread running {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:40:15.665963 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_db.sqlalchemy.engines [None req-e60a9c15-b16c-4b8d-a6ab-a945cd968b42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:40:15.673907 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writer thread running {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:40:15.706464 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.context [None req-bf378ba9-0a8a-4721-9dca-b90c47c7cb7a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),97163b7c-dec1-42e2-8be2-4fecb8140df7(cell1) {{(pid=124267) load_cells /opt/stack/nova/nova/context.py:464}} May 26 16:40:15.711286 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bf378ba9-0a8a-4721-9dca-b90c47c7cb7a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:40:15.712964 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bf378ba9-0a8a-4721-9dca-b90c47c7cb7a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:40:15.713790 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bf378ba9-0a8a-4721-9dca-b90c47c7cb7a None None] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:40:15.715793 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bf378ba9-0a8a-4721-9dca-b90c47c7cb7a None None] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:40:15.717806 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO dbcounter [None req-bf378ba9-0a8a-4721-9dca-b90c47c7cb7a None None] Registered counter for database nova_cell0 May 26 16:40:15.723644 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO dbcounter [None req-bf378ba9-0a8a-4721-9dca-b90c47c7cb7a None None] Registered counter for database nova_cell1 May 26 16:40:15.732748 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_db.sqlalchemy.engines [None req-bf378ba9-0a8a-4721-9dca-b90c47c7cb7a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:40:15.733983 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.context [None req-e60a9c15-b16c-4b8d-a6ab-a945cd968b42 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),97163b7c-dec1-42e2-8be2-4fecb8140df7(cell1) {{(pid=124266) load_cells /opt/stack/nova/nova/context.py:464}} May 26 16:40:15.737581 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writer thread running {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:40:15.738205 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e60a9c15-b16c-4b8d-a6ab-a945cd968b42 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:40:15.739839 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e60a9c15-b16c-4b8d-a6ab-a945cd968b42 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:40:15.740753 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e60a9c15-b16c-4b8d-a6ab-a945cd968b42 None None] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:40:15.742796 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e60a9c15-b16c-4b8d-a6ab-a945cd968b42 None None] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:40:15.744842 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO dbcounter [None req-e60a9c15-b16c-4b8d-a6ab-a945cd968b42 None None] Registered counter for database nova_cell0 May 26 16:40:15.748939 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO dbcounter [None req-e60a9c15-b16c-4b8d-a6ab-a945cd968b42 None None] Registered counter for database nova_cell1 May 26 16:40:15.756743 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_db.sqlalchemy.engines [None req-e60a9c15-b16c-4b8d-a6ab-a945cd968b42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:40:15.761819 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writer thread running {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:40:15.762488 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_db.sqlalchemy.engines [None req-e60a9c15-b16c-4b8d-a6ab-a945cd968b42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:40:15.879158 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_db.sqlalchemy.engines [None req-bf378ba9-0a8a-4721-9dca-b90c47c7cb7a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:40:15.884303 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writer thread running {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:40:15.893891 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO dbcounter [None req-bf378ba9-0a8a-4721-9dca-b90c47c7cb7a None None] Registered counter for database nova_cell0 May 26 16:40:15.903905 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_db.sqlalchemy.engines [None req-bf378ba9-0a8a-4721-9dca-b90c47c7cb7a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:40:15.907980 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writer thread running {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:40:15.908606 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writer thread running {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:40:15.917288 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO dbcounter [None req-e60a9c15-b16c-4b8d-a6ab-a945cd968b42 None None] Registered counter for database nova_cell0 May 26 16:40:15.924089 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_db.sqlalchemy.engines [None req-e60a9c15-b16c-4b8d-a6ab-a945cd968b42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:40:15.929528 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writer thread running {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:40:16.232191 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: WARNING keystonemiddleware.auth_token [None req-bf378ba9-0a8a-4721-9dca-b90c47c7cb7a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 16:40:16.239484 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: WARNING keystonemiddleware.auth_token [None req-bf378ba9-0a8a-4721-9dca-b90c47c7cb7a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 16:40:16.264394 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: WARNING keystonemiddleware.auth_token [None req-e60a9c15-b16c-4b8d-a6ab-a945cd968b42 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 16:40:16.272217 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: WARNING keystonemiddleware.auth_token [None req-e60a9c15-b16c-4b8d-a6ab-a945cd968b42 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 16:40:16.588053 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: WARNING keystonemiddleware.auth_token [None req-bf378ba9-0a8a-4721-9dca-b90c47c7cb7a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 16:40:16.594229 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: WARNING keystonemiddleware.auth_token [None req-bf378ba9-0a8a-4721-9dca-b90c47c7cb7a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 16:40:16.600184 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557fbcf0d9c0 pid: 124267 (default app) May 26 16:40:16.623238 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: WARNING keystonemiddleware.auth_token [None req-e60a9c15-b16c-4b8d-a6ab-a945cd968b42 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 16:40:16.629449 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: WARNING keystonemiddleware.auth_token [None req-e60a9c15-b16c-4b8d-a6ab-a945cd968b42 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 16:40:16.634837 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557fbcf0d9c0 pid: 124266 (default app) May 26 16:40:59.379962 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_api:SELECT=3 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:40:59.381471 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=3 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:40:59.388430 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell0:SELECT=3 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:40:59.389471 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell0:SELECT=3 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:40:59.639721 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=3 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:40:59.641687 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=3 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:40:59.644464 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=3 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:40:59.646151 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=3 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:00.519778 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d12d7e53-dcb5-4c4a-bc36-eef04a216271 tempest-VolumesGetTestJSON-1501673832 tempest-VolumesGetTestJSON-1501673832-project] Action: 'create', calling method: .version_select at 0x7f93b1d00ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1798319085", "metadata": {"Type": "work"}}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:41:00.659894 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-8fd234e1-8326-4ca3-8f2e-3bfa377df908 tempest-VolumesNegativeTest-556919386 tempest-VolumesNegativeTest-556919386-project] Action: 'create', calling method: .version_select at 0x7f93b1cffca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-716790297", "metadata": {"Type": "work"}}} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:41:00.693105 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-8fd234e1-8326-4ca3-8f2e-3bfa377df908 tempest-VolumesNegativeTest-556919386 tempest-VolumesNegativeTest-556919386-project] Request method failure captured: May 26 16:41:00.693105 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 16:41:00.693105 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept: application/json May 26 16:41:00.693105 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept-Encoding: identity May 26 16:41:00.693105 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Connection: close May 26 16:41:00.693105 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Length: 121 May 26 16:41:00.693105 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Type: application/json May 26 16:41:00.693105 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Host: 10.222.0.102 May 26 16:41:00.693105 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Openstack-System-Scope: None May 26 16:41:00.693105 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: User-Agent: python-urllib3/1.26.9 May 26 16:41:00.693105 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Auth-Token: gAAAAABij62beJJYk0-zG0APmpjQ1d7nxK18CUWTr_Rho1zsdBg1iGK3Mz0pS8a-zSMgnkZBLP9RLNeiAp7qJYCn0VBiW4LfAlFIz7Fw9VgIehBK0WgJuw8A1XyBDPzwHMkIQA8Fg7YOHOgcjvcOCxU--gKZHALp8OM_YB3zkMvtoO0dz0sBvIE May 26 16:41:00.693105 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Id: None May 26 16:41:00.693105 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Name: None May 26 16:41:00.693105 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Identity-Status: Confirmed May 26 16:41:00.693105 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Is-Admin-Project: True May 26 16:41:00.693105 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Id: default May 26 16:41:00.693105 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Name: Default May 26 16:41:00.693105 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Id: 17477531deb44fe88e22af96c9067647 May 26 16:41:00.693105 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Name: tempest-VolumesNegativeTest-556919386 May 26 16:41:00.693105 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Role: reader,member May 26 16:41:00.693105 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Roles: reader,member May 26 16:41:00.694602 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/17477531deb44fe88e22af96c9067647"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/17477531deb44fe88e22af96c9067647"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/17477531deb44fe88e22af96c9067647"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_17477531deb44fe88e22af96c9067647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:41:00.694602 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant: tempest-VolumesNegativeTest-556919386 May 26 16:41:00.694602 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Id: 17477531deb44fe88e22af96c9067647 May 26 16:41:00.694602 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Name: tempest-VolumesNegativeTest-556919386 May 26 16:41:00.694602 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User: tempest-VolumesNegativeTest-556919386-project May 26 16:41:00.694602 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Id: default May 26 16:41:00.694602 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Name: Default May 26 16:41:00.694602 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Id: 104a0314044d441c86a94847a83bd9ff May 26 16:41:00.694602 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Name: tempest-VolumesNegativeTest-556919386-project May 26 16:41:00.694602 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: May 26 16:41:00.694602 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-716790297", "metadata": {"Type": "work"}}} May 26 16:41:00.694602 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: method: May 26 16:41:00.694602 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 16:41:00.695618 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-716790297', 'metadata': {'Type': 'work'}}}} May 26 16:41:00.695618 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:41:00.695618 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:00.695618 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 16:41:00.695618 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 16:41:00.695618 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 16:41:00.695618 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise error May 26 16:41:00.695618 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 26 16:41:00.695618 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:41:00.695618 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 26 16:41:00.695618 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 16:41:00.695618 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:41:00.695618 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 16:41:00.695618 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi '#$%' May 26 16:41:00.695618 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:41:00.695618 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:41:00.695618 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:41:00.695618 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:00.695618 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:41:00.695618 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:41:00.695618 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:41:00.695618 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:41:00.697254 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 16:41:00.697254 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 16:41:00.697254 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:41:00.697254 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:41:00.697254 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 16:41:00.697254 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 16:41:00.697254 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 16:41:00.697254 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 16:41:00.697254 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 16:41:00.697254 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 16:41:00.697254 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 16:41:00.697254 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:41:00.697254 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:41:00.697254 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:41:00.697254 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:00.697254 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:41:00.697254 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:41:00.697254 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 16:41:00.697254 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 16:41:00.698621 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 16:41:00.698621 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:41:00.699864 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-8fd234e1-8326-4ca3-8f2e-3bfa377df908 tempest-VolumesNegativeTest-556919386 tempest-VolumesNegativeTest-556919386-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:41:00.701850 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-8fd234e1-8326-4ca3-8f2e-3bfa377df908 tempest-VolumesNegativeTest-556919386 tempest-VolumesNegativeTest-556919386-project] 10.222.0.102 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.336115 May 26 16:41:00.709185 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 1/1] 10.222.0.102 () {60 vars in 1160 bytes} [Thu May 26 16:40:59 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1346 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 16:41:00.780888 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-e47e592d-da5d-45cb-bd4a-26fc9ad79283 tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] Action: 'create', calling method: .version_select at 0x7f93b1bd4f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1789651799"}} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:41:01.737209 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-e47e592d-da5d-45cb-bd4a-26fc9ad79283 tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] 10.222.0.102 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.024717 May 26 16:41:01.738349 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 2/2] 10.222.0.102 () {60 vars in 1159 bytes} [Thu May 26 16:41:00 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1028 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) May 26 16:41:01.798757 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d12d7e53-dcb5-4c4a-bc36-eef04a216271 tempest-VolumesGetTestJSON-1501673832 tempest-VolumesGetTestJSON-1501673832-project] 10.222.0.102 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.165919 May 26 16:41:01.799407 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 1/3] 10.222.0.102 () {60 vars in 1160 bytes} [Thu May 26 16:40:59 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2169 msecs (HTTP/1.1 200) 10 headers in 449 bytes (2 switches on core 0) May 26 16:41:01.805288 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-87d64c56-d2d1-4913-9308-b77106f134fb tempest-VolumesNegativeTest-556919386 tempest-VolumesNegativeTest-556919386-project] Action: 'create', calling method: .version_select at 0x7f93b1b50b80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2048536860", "metadata": {"Type": "work"}}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:41:01.823277 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-87d64c56-d2d1-4913-9308-b77106f134fb tempest-VolumesNegativeTest-556919386 tempest-VolumesNegativeTest-556919386-project] Request method failure captured: May 26 16:41:01.823277 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 16:41:01.823277 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept: application/json May 26 16:41:01.823277 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity May 26 16:41:01.823277 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Connection: close May 26 16:41:01.823277 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Length: 120 May 26 16:41:01.823277 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Type: application/json May 26 16:41:01.823277 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Host: 10.222.0.102 May 26 16:41:01.823277 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None May 26 16:41:01.823277 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 May 26 16:41:01.823277 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABij62beJJYk0-zG0APmpjQ1d7nxK18CUWTr_Rho1zsdBg1iGK3Mz0pS8a-zSMgnkZBLP9RLNeiAp7qJYCn0VBiW4LfAlFIz7Fw9VgIehBK0WgJuw8A1XyBDPzwHMkIQA8Fg7YOHOgcjvcOCxU--gKZHALp8OM_YB3zkMvtoO0dz0sBvIE May 26 16:41:01.823277 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Id: None May 26 16:41:01.823277 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Name: None May 26 16:41:01.823277 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed May 26 16:41:01.823277 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True May 26 16:41:01.823277 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default May 26 16:41:01.823277 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default May 26 16:41:01.823277 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Id: 17477531deb44fe88e22af96c9067647 May 26 16:41:01.823277 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-VolumesNegativeTest-556919386 May 26 16:41:01.823277 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Role: reader,member May 26 16:41:01.823277 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Roles: reader,member May 26 16:41:01.824715 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/17477531deb44fe88e22af96c9067647"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/17477531deb44fe88e22af96c9067647"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/17477531deb44fe88e22af96c9067647"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_17477531deb44fe88e22af96c9067647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:41:01.824715 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-VolumesNegativeTest-556919386 May 26 16:41:01.824715 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Id: 17477531deb44fe88e22af96c9067647 May 26 16:41:01.824715 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-VolumesNegativeTest-556919386 May 26 16:41:01.824715 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User: tempest-VolumesNegativeTest-556919386-project May 26 16:41:01.824715 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default May 26 16:41:01.824715 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default May 26 16:41:01.824715 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Id: 104a0314044d441c86a94847a83bd9ff May 26 16:41:01.824715 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-VolumesNegativeTest-556919386-project May 26 16:41:01.824715 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: May 26 16:41:01.824715 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2048536860", "metadata": {"Type": "work"}}} May 26 16:41:01.824715 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: method: May 26 16:41:01.824715 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 16:41:01.825523 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2048536860', 'metadata': {'Type': 'work'}}}} May 26 16:41:01.825523 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:41:01.825523 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:01.825523 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 16:41:01.825523 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 16:41:01.825523 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 16:41:01.825523 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise error May 26 16:41:01.825523 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 26 16:41:01.825523 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:01.825523 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 26 16:41:01.825523 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 16:41:01.825523 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:01.825523 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 16:41:01.825523 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi '0' May 26 16:41:01.825523 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:01.825523 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:41:01.825523 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:01.825523 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:01.825523 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:41:01.825523 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:41:01.825523 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:41:01.825523 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:41:01.826880 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 16:41:01.826880 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 16:41:01.826880 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:41:01.826880 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:41:01.826880 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 16:41:01.826880 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 16:41:01.826880 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 16:41:01.826880 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 16:41:01.826880 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 16:41:01.826880 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 16:41:01.826880 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 16:41:01.826880 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:01.826880 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:41:01.826880 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:01.826880 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:01.826880 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:41:01.826880 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:41:01.826880 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 16:41:01.826880 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 16:41:01.829999 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 16:41:01.829999 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:01.841778 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-87d64c56-d2d1-4913-9308-b77106f134fb tempest-VolumesNegativeTest-556919386 tempest-VolumesNegativeTest-556919386-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:41:01.843427 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-87d64c56-d2d1-4913-9308-b77106f134fb tempest-VolumesNegativeTest-556919386 tempest-VolumesNegativeTest-556919386-project] 10.222.0.102 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.042717 May 26 16:41:01.844963 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 2/4] 10.222.0.102 () {60 vars in 1160 bytes} [Thu May 26 16:41:01 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 16:41:01.853830 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-945a3d03-8909-4682-b081-45a43fa04ea4 tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] Calling method '.version_select at 0x7f93b1b50ee0>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:01.858357 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-66dca667-6a6d-41cd-b244-1bbecc5554ec tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1286904847", "imageRef": "d74c4a51-21fe-41d5-865a-cb93604ac3aa", "flavorRef": "452", "networks": [{"uuid": "ea9f1ec0-a236-4cdd-903b-33b40956e6ac"}]}} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:41:01.919425 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-945a3d03-8909-4682-b081-45a43fa04ea4 tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/49d76927-e455-40b6-adbf-b9af63039985" status: 200 len: 345 microversion: 2.1 time: 0.072930 May 26 16:41:01.925780 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 3/5] 10.222.0.102 () {58 vars in 1249 bytes} [Thu May 26 16:41:01 2022] GET /compute/v2.1/os-volumes/49d76927-e455-40b6-adbf-b9af63039985 => generated 345 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:41:01.931759 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0a314fa9-27fc-411c-9e35-c19baecfa8a5 tempest-VolumesGetTestJSON-1501673832 tempest-VolumesGetTestJSON-1501673832-project] Calling method '.version_select at 0x7f93b1b623a0>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:01.994993 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0a314fa9-27fc-411c-9e35-c19baecfa8a5 tempest-VolumesGetTestJSON-1501673832 tempest-VolumesGetTestJSON-1501673832-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/1fc6ff5f-6910-4cc8-a9b4-9ae232be649b" status: 200 len: 353 microversion: 2.1 time: 0.067455 May 26 16:41:02.001402 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 4/6] 10.222.0.102 () {58 vars in 1249 bytes} [Thu May 26 16:41:01 2022] GET /compute/v2.1/os-volumes/1fc6ff5f-6910-4cc8-a9b4-9ae232be649b => generated 353 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:41:02.006765 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-bbee9d7d-70a4-4dc9-b955-648abd91cd22 tempest-VolumesNegativeTest-556919386 tempest-VolumesNegativeTest-556919386-project] Action: 'create', calling method: .version_select at 0x7f93b1b62ee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2086976977", "metadata": {"Type": "work"}}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:41:02.010113 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-bbee9d7d-70a4-4dc9-b955-648abd91cd22 tempest-VolumesNegativeTest-556919386 tempest-VolumesNegativeTest-556919386-project] Request method failure captured: May 26 16:41:02.010113 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 16:41:02.010113 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept: application/json May 26 16:41:02.010113 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity May 26 16:41:02.010113 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Connection: close May 26 16:41:02.010113 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Length: 119 May 26 16:41:02.010113 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Type: application/json May 26 16:41:02.010113 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Host: 10.222.0.102 May 26 16:41:02.010113 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None May 26 16:41:02.010113 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 May 26 16:41:02.010113 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABij62beJJYk0-zG0APmpjQ1d7nxK18CUWTr_Rho1zsdBg1iGK3Mz0pS8a-zSMgnkZBLP9RLNeiAp7qJYCn0VBiW4LfAlFIz7Fw9VgIehBK0WgJuw8A1XyBDPzwHMkIQA8Fg7YOHOgcjvcOCxU--gKZHALp8OM_YB3zkMvtoO0dz0sBvIE May 26 16:41:02.010113 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Id: None May 26 16:41:02.010113 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Name: None May 26 16:41:02.010113 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed May 26 16:41:02.010113 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True May 26 16:41:02.010113 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default May 26 16:41:02.010113 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default May 26 16:41:02.010113 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Id: 17477531deb44fe88e22af96c9067647 May 26 16:41:02.010113 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-VolumesNegativeTest-556919386 May 26 16:41:02.010113 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Role: reader,member May 26 16:41:02.010113 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Roles: reader,member May 26 16:41:02.011461 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/17477531deb44fe88e22af96c9067647"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/17477531deb44fe88e22af96c9067647"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/17477531deb44fe88e22af96c9067647"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_17477531deb44fe88e22af96c9067647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:41:02.011461 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-VolumesNegativeTest-556919386 May 26 16:41:02.011461 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Id: 17477531deb44fe88e22af96c9067647 May 26 16:41:02.011461 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-VolumesNegativeTest-556919386 May 26 16:41:02.011461 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User: tempest-VolumesNegativeTest-556919386-project May 26 16:41:02.011461 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default May 26 16:41:02.011461 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default May 26 16:41:02.011461 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Id: 104a0314044d441c86a94847a83bd9ff May 26 16:41:02.011461 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-VolumesNegativeTest-556919386-project May 26 16:41:02.011461 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: May 26 16:41:02.011461 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2086976977", "metadata": {"Type": "work"}}} May 26 16:41:02.011461 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: method: May 26 16:41:02.011461 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 16:41:02.012282 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2086976977', 'metadata': {'Type': 'work'}}}} May 26 16:41:02.012282 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:41:02.012282 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:02.012282 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 16:41:02.012282 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 16:41:02.012282 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 16:41:02.012282 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise error May 26 16:41:02.012282 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 26 16:41:02.012282 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:02.012282 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 26 16:41:02.012282 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 16:41:02.012282 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:02.012282 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 16:41:02.012282 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi '' May 26 16:41:02.012282 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:02.012282 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:41:02.012282 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:02.012282 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:02.012282 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:41:02.012282 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:41:02.012282 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:41:02.012282 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:41:02.013565 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 16:41:02.013565 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 16:41:02.013565 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:41:02.013565 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:41:02.013565 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 16:41:02.013565 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 16:41:02.013565 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 16:41:02.013565 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 16:41:02.013565 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 16:41:02.013565 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 16:41:02.013565 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 16:41:02.013565 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:02.013565 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:41:02.013565 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:02.013565 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:02.013565 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:41:02.013565 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:41:02.013565 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 16:41:02.013565 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 16:41:02.014692 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 16:41:02.014692 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:02.017077 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-bbee9d7d-70a4-4dc9-b955-648abd91cd22 tempest-VolumesNegativeTest-556919386 tempest-VolumesNegativeTest-556919386-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:41:02.018200 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-bbee9d7d-70a4-4dc9-b955-648abd91cd22 tempest-VolumesNegativeTest-556919386 tempest-VolumesNegativeTest-556919386-project] 10.222.0.102 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015425 May 26 16:41:02.019473 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 5/7] 10.222.0.102 () {60 vars in 1160 bytes} [Thu May 26 16:41:02 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 16:41:02.031464 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-21e6d092-c4a5-49d1-98d6-c9061ac3655e tempest-VolumesNegativeTest-556919386 tempest-VolumesNegativeTest-556919386-project] Calling method '.version_select at 0x7f93b24e4280>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:02.038577 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.network.neutron [None req-66dca667-6a6d-41cd-b244-1bbecc5554ec tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] validate_networks() for [('ea9f1ec0-a236-4cdd-903b-33b40956e6ac', None, None, None, None, None)] {{(pid=124267) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:41:02.066788 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-21e6d092-c4a5-49d1-98d6-c9061ac3655e tempest-VolumesNegativeTest-556919386 tempest-VolumesNegativeTest-556919386-project] HTTP exception thrown: Volume tempest-invalid-1544675585 could not be found. May 26 16:41:02.071320 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-21e6d092-c4a5-49d1-98d6-c9061ac3655e tempest-VolumesNegativeTest-556919386 tempest-VolumesNegativeTest-556919386-project] Request method failure captured: May 26 16:41:02.071320 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1544675585 HTTP/1.1 May 26 16:41:02.071320 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept: application/json May 26 16:41:02.071320 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity May 26 16:41:02.071320 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Connection: close May 26 16:41:02.071320 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Length: 0 May 26 16:41:02.071320 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Type: application/json May 26 16:41:02.071320 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Host: 10.222.0.102 May 26 16:41:02.071320 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None May 26 16:41:02.071320 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 May 26 16:41:02.071320 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABij62beJJYk0-zG0APmpjQ1d7nxK18CUWTr_Rho1zsdBg1iGK3Mz0pS8a-zSMgnkZBLP9RLNeiAp7qJYCn0VBiW4LfAlFIz7Fw9VgIehBK0WgJuw8A1XyBDPzwHMkIQA8Fg7YOHOgcjvcOCxU--gKZHALp8OM_YB3zkMvtoO0dz0sBvIE May 26 16:41:02.071320 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Id: None May 26 16:41:02.071320 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Name: None May 26 16:41:02.071320 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed May 26 16:41:02.071320 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True May 26 16:41:02.071320 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default May 26 16:41:02.071320 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default May 26 16:41:02.071320 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Id: 17477531deb44fe88e22af96c9067647 May 26 16:41:02.071320 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-VolumesNegativeTest-556919386 May 26 16:41:02.071320 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Role: reader,member May 26 16:41:02.071320 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Roles: reader,member May 26 16:41:02.073037 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/17477531deb44fe88e22af96c9067647"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/17477531deb44fe88e22af96c9067647"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/17477531deb44fe88e22af96c9067647"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_17477531deb44fe88e22af96c9067647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:41:02.073037 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-VolumesNegativeTest-556919386 May 26 16:41:02.073037 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Id: 17477531deb44fe88e22af96c9067647 May 26 16:41:02.073037 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-VolumesNegativeTest-556919386 May 26 16:41:02.073037 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User: tempest-VolumesNegativeTest-556919386-project May 26 16:41:02.073037 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default May 26 16:41:02.073037 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default May 26 16:41:02.073037 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Id: 104a0314044d441c86a94847a83bd9ff May 26 16:41:02.073037 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-VolumesNegativeTest-556919386-project May 26 16:41:02.073037 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: method: May 26 16:41:02.073037 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: exception: Volume tempest-invalid-1544675585 could not be found. May 26 16:41:02.073037 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: action_args: {'id': 'tempest-invalid-1544675585'} May 26 16:41:02.073037 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:41:02.073836 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:02.073836 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 16:41:02.073836 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 16:41:02.073836 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 16:41:02.073836 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 16:41:02.073836 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 16:41:02.073836 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 16:41:02.073836 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 16:41:02.073836 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 16:41:02.073836 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 16:41:02.073836 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 16:41:02.073836 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 16:41:02.073836 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 16:41:02.073836 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 16:41:02.073836 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 16:41:02.073836 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1544675585 could not be found. (HTTP 404) (Request-ID: req-54db9c4b-6172-461d-848b-14f67ea78b4a) May 26 16:41:02.073836 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:02.073836 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:41:02.073836 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:02.075007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:02.075007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 16:41:02.075007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 16:41:02.075007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 16:41:02.075007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 16:41:02.075007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 16:41:02.075007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 16:41:02.075007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 16:41:02.075007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 16:41:02.075007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 16:41:02.075007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 16:41:02.075007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 16:41:02.075007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 16:41:02.075007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 16:41:02.075007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 16:41:02.075007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 16:41:02.075007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 16:41:02.075007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 16:41:02.075007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 16:41:02.076174 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 16:41:02.076174 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 16:41:02.076174 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 16:41:02.076174 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 16:41:02.076174 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1544675585 could not be found. May 26 16:41:02.076174 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:02.076174 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:41:02.076174 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:02.076174 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:02.076174 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:41:02.076174 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:41:02.076174 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:41:02.076174 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:41:02.076174 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 16:41:02.076174 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 16:41:02.076174 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:41:02.076174 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:41:02.076174 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 16:41:02.076174 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:41:02.076174 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1544675585 could not be found. May 26 16:41:02.078266 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:02.078266 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:41:02.078266 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:02.078266 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:02.078266 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:41:02.078266 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:41:02.078266 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:41:02.078266 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:41:02.078266 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1544675585 could not be found. May 26 16:41:02.078266 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:02.081554 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-21e6d092-c4a5-49d1-98d6-c9061ac3655e tempest-VolumesNegativeTest-556919386 tempest-VolumesNegativeTest-556919386-project] Returning 404 to user: Volume tempest-invalid-1544675585 could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:41:02.082714 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-21e6d092-c4a5-49d1-98d6-c9061ac3655e tempest-VolumesNegativeTest-556919386 tempest-VolumesNegativeTest-556919386-project] 10.222.0.102 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1544675585" status: 404 len: 99 microversion: 2.1 time: 0.057482 May 26 16:41:02.083840 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 6/8] 10.222.0.102 () {58 vars in 1222 bytes} [Thu May 26 16:41:02 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1544675585 => generated 99 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 26 16:41:02.098385 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-08e4fe3b-773b-439c-aac8-3f374a63f53f tempest-VolumesNegativeTest-556919386 tempest-VolumesNegativeTest-556919386-project] 10.222.0.102 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005329 May 26 16:41:02.098951 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 7/9] 10.222.0.102 () {58 vars in 1144 bytes} [Thu May 26 16:41:02 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 26 16:41:02.109091 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-148435c2-4fe4-410f-88d7-7e51b9839e6d tempest-VolumesNegativeTest-556919386 tempest-VolumesNegativeTest-556919386-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004008 May 26 16:41:02.110569 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 8/10] 10.222.0.102 () {58 vars in 1141 bytes} [Thu May 26 16:41:02 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 26 16:41:02.121880 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ee25bd48-411f-4ece-9846-51e52ba479dd tempest-VolumesNegativeTest-556919386 tempest-VolumesNegativeTest-556919386-project] Calling method '.version_select at 0x7f93b1aeb310>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:02.160866 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-ee25bd48-411f-4ece-9846-51e52ba479dd tempest-VolumesNegativeTest-556919386 tempest-VolumesNegativeTest-556919386-project] HTTP exception thrown: Volume 98d49a33-74c7-423f-a227-9f6eb04ae06c could not be found. May 26 16:41:02.164703 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ee25bd48-411f-4ece-9846-51e52ba479dd tempest-VolumesNegativeTest-556919386 tempest-VolumesNegativeTest-556919386-project] Request method failure captured: May 26 16:41:02.164703 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: request: DELETE /compute/v2.1/os-volumes/98d49a33-74c7-423f-a227-9f6eb04ae06c HTTP/1.1 May 26 16:41:02.164703 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept: application/json May 26 16:41:02.164703 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity May 26 16:41:02.164703 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Connection: close May 26 16:41:02.164703 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Length: 0 May 26 16:41:02.164703 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Type: application/json May 26 16:41:02.164703 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Host: 10.222.0.102 May 26 16:41:02.164703 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None May 26 16:41:02.164703 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 May 26 16:41:02.164703 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABij62beJJYk0-zG0APmpjQ1d7nxK18CUWTr_Rho1zsdBg1iGK3Mz0pS8a-zSMgnkZBLP9RLNeiAp7qJYCn0VBiW4LfAlFIz7Fw9VgIehBK0WgJuw8A1XyBDPzwHMkIQA8Fg7YOHOgcjvcOCxU--gKZHALp8OM_YB3zkMvtoO0dz0sBvIE May 26 16:41:02.164703 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Id: None May 26 16:41:02.164703 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Name: None May 26 16:41:02.164703 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed May 26 16:41:02.164703 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True May 26 16:41:02.164703 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default May 26 16:41:02.164703 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default May 26 16:41:02.164703 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Id: 17477531deb44fe88e22af96c9067647 May 26 16:41:02.164703 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-VolumesNegativeTest-556919386 May 26 16:41:02.164703 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Role: reader,member May 26 16:41:02.164703 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Roles: reader,member May 26 16:41:02.165981 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/17477531deb44fe88e22af96c9067647"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/17477531deb44fe88e22af96c9067647"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/17477531deb44fe88e22af96c9067647"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_17477531deb44fe88e22af96c9067647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:41:02.165981 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-VolumesNegativeTest-556919386 May 26 16:41:02.165981 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Id: 17477531deb44fe88e22af96c9067647 May 26 16:41:02.165981 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-VolumesNegativeTest-556919386 May 26 16:41:02.165981 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User: tempest-VolumesNegativeTest-556919386-project May 26 16:41:02.165981 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default May 26 16:41:02.165981 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default May 26 16:41:02.165981 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Id: 104a0314044d441c86a94847a83bd9ff May 26 16:41:02.165981 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-VolumesNegativeTest-556919386-project May 26 16:41:02.165981 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: method: May 26 16:41:02.165981 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: exception: Volume 98d49a33-74c7-423f-a227-9f6eb04ae06c could not be found. May 26 16:41:02.165981 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: action_args: {'id': '98d49a33-74c7-423f-a227-9f6eb04ae06c'} May 26 16:41:02.165981 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:41:02.166784 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:02.166784 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 16:41:02.166784 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 16:41:02.166784 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 16:41:02.166784 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 16:41:02.166784 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 16:41:02.166784 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 16:41:02.166784 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 16:41:02.166784 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 16:41:02.166784 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 16:41:02.166784 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 16:41:02.166784 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 16:41:02.166784 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 16:41:02.166784 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 16:41:02.166784 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 16:41:02.166784 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 98d49a33-74c7-423f-a227-9f6eb04ae06c could not be found. (HTTP 404) (Request-ID: req-728d30b9-25c1-4d60-b92b-5147a2b14976) May 26 16:41:02.166784 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:02.166784 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:41:02.166784 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:02.167888 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:02.167888 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 16:41:02.167888 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 16:41:02.167888 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 16:41:02.167888 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 16:41:02.167888 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 16:41:02.167888 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 16:41:02.167888 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 16:41:02.167888 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 16:41:02.167888 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 16:41:02.167888 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 16:41:02.167888 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 16:41:02.167888 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 16:41:02.167888 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 16:41:02.167888 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 16:41:02.167888 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 16:41:02.167888 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 16:41:02.167888 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 16:41:02.167888 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 16:41:02.169012 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 16:41:02.169012 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 16:41:02.169012 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 16:41:02.169012 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 16:41:02.169012 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 98d49a33-74c7-423f-a227-9f6eb04ae06c could not be found. May 26 16:41:02.169012 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:02.169012 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:41:02.169012 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:02.169012 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:02.169012 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:41:02.169012 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:41:02.169012 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:41:02.169012 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:41:02.169012 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 16:41:02.169012 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 16:41:02.169012 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:41:02.169012 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:41:02.169012 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 16:41:02.169012 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:41:02.170089 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 98d49a33-74c7-423f-a227-9f6eb04ae06c could not be found. May 26 16:41:02.170089 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:02.170089 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:41:02.170089 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:02.170089 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:02.170089 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:41:02.170089 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:41:02.170089 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:41:02.170089 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:41:02.170089 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 98d49a33-74c7-423f-a227-9f6eb04ae06c could not be found. May 26 16:41:02.170089 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:02.173340 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ee25bd48-411f-4ece-9846-51e52ba479dd tempest-VolumesNegativeTest-556919386 tempest-VolumesNegativeTest-556919386-project] Returning 404 to user: Volume 98d49a33-74c7-423f-a227-9f6eb04ae06c could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:41:02.174511 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ee25bd48-411f-4ece-9846-51e52ba479dd tempest-VolumesNegativeTest-556919386 tempest-VolumesNegativeTest-556919386-project] 10.222.0.102 "DELETE /compute/v2.1/os-volumes/98d49a33-74c7-423f-a227-9f6eb04ae06c" status: 404 len: 109 microversion: 2.1 time: 0.058880 May 26 16:41:02.175645 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 9/11] 10.222.0.102 () {58 vars in 1252 bytes} [Thu May 26 16:41:02 2022] DELETE /compute/v2.1/os-volumes/98d49a33-74c7-423f-a227-9f6eb04ae06c => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 16:41:02.190404 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-81d2e53f-8d78-45c0-ac55-1f3f7c4b7fd5 tempest-VolumesNegativeTest-556919386 tempest-VolumesNegativeTest-556919386-project] Calling method '.version_select at 0x7f93b1b1a9d0>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:02.227938 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-81d2e53f-8d78-45c0-ac55-1f3f7c4b7fd5 tempest-VolumesNegativeTest-556919386 tempest-VolumesNegativeTest-556919386-project] HTTP exception thrown: Volume 73959690-680d-45b3-8f5b-62c17cd456b5 could not be found. May 26 16:41:02.230958 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-81d2e53f-8d78-45c0-ac55-1f3f7c4b7fd5 tempest-VolumesNegativeTest-556919386 tempest-VolumesNegativeTest-556919386-project] Request method failure captured: May 26 16:41:02.230958 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/os-volumes/73959690-680d-45b3-8f5b-62c17cd456b5 HTTP/1.1 May 26 16:41:02.230958 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept: application/json May 26 16:41:02.230958 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity May 26 16:41:02.230958 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Connection: close May 26 16:41:02.230958 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Length: 0 May 26 16:41:02.230958 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Type: application/json May 26 16:41:02.230958 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Host: 10.222.0.102 May 26 16:41:02.230958 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None May 26 16:41:02.230958 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 May 26 16:41:02.230958 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABij62beJJYk0-zG0APmpjQ1d7nxK18CUWTr_Rho1zsdBg1iGK3Mz0pS8a-zSMgnkZBLP9RLNeiAp7qJYCn0VBiW4LfAlFIz7Fw9VgIehBK0WgJuw8A1XyBDPzwHMkIQA8Fg7YOHOgcjvcOCxU--gKZHALp8OM_YB3zkMvtoO0dz0sBvIE May 26 16:41:02.230958 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Id: None May 26 16:41:02.230958 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Name: None May 26 16:41:02.230958 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed May 26 16:41:02.230958 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True May 26 16:41:02.230958 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default May 26 16:41:02.230958 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default May 26 16:41:02.230958 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Id: 17477531deb44fe88e22af96c9067647 May 26 16:41:02.230958 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-VolumesNegativeTest-556919386 May 26 16:41:02.230958 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Role: reader,member May 26 16:41:02.230958 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Roles: reader,member May 26 16:41:02.232260 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/17477531deb44fe88e22af96c9067647"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/17477531deb44fe88e22af96c9067647"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/17477531deb44fe88e22af96c9067647"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_17477531deb44fe88e22af96c9067647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:41:02.232260 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-VolumesNegativeTest-556919386 May 26 16:41:02.232260 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Id: 17477531deb44fe88e22af96c9067647 May 26 16:41:02.232260 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-VolumesNegativeTest-556919386 May 26 16:41:02.232260 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User: tempest-VolumesNegativeTest-556919386-project May 26 16:41:02.232260 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default May 26 16:41:02.232260 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default May 26 16:41:02.232260 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Id: 104a0314044d441c86a94847a83bd9ff May 26 16:41:02.232260 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-VolumesNegativeTest-556919386-project May 26 16:41:02.232260 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: method: May 26 16:41:02.232260 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: exception: Volume 73959690-680d-45b3-8f5b-62c17cd456b5 could not be found. May 26 16:41:02.232260 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: action_args: {'id': '73959690-680d-45b3-8f5b-62c17cd456b5'} May 26 16:41:02.232260 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:41:02.233080 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:02.233080 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 16:41:02.233080 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 16:41:02.233080 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 16:41:02.233080 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 16:41:02.233080 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 16:41:02.233080 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 16:41:02.233080 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 16:41:02.233080 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 16:41:02.233080 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 16:41:02.233080 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 16:41:02.233080 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 16:41:02.233080 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 16:41:02.233080 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 16:41:02.233080 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 16:41:02.233080 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 73959690-680d-45b3-8f5b-62c17cd456b5 could not be found. (HTTP 404) (Request-ID: req-ad376531-8a92-4a38-97d1-e7c771dc03cd) May 26 16:41:02.233080 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:02.233080 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:41:02.233080 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:02.234379 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:02.234379 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 16:41:02.234379 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 16:41:02.234379 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 16:41:02.234379 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 16:41:02.234379 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 16:41:02.234379 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 16:41:02.234379 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 16:41:02.234379 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 16:41:02.234379 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 16:41:02.234379 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 16:41:02.234379 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 16:41:02.234379 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 16:41:02.234379 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 16:41:02.234379 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 16:41:02.234379 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 16:41:02.234379 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 16:41:02.234379 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 16:41:02.234379 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 16:41:02.235624 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 16:41:02.235624 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 16:41:02.235624 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 16:41:02.235624 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 16:41:02.235624 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 73959690-680d-45b3-8f5b-62c17cd456b5 could not be found. May 26 16:41:02.235624 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:02.235624 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:41:02.235624 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:02.235624 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:02.235624 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:41:02.235624 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:41:02.235624 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:41:02.235624 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:41:02.235624 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 16:41:02.235624 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 16:41:02.235624 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:41:02.235624 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:41:02.235624 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 16:41:02.235624 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:41:02.236771 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 73959690-680d-45b3-8f5b-62c17cd456b5 could not be found. May 26 16:41:02.236771 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:02.236771 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:41:02.236771 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:02.236771 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:02.236771 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:41:02.236771 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:41:02.236771 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:41:02.236771 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:41:02.236771 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 73959690-680d-45b3-8f5b-62c17cd456b5 could not be found. May 26 16:41:02.236771 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:02.239933 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-81d2e53f-8d78-45c0-ac55-1f3f7c4b7fd5 tempest-VolumesNegativeTest-556919386 tempest-VolumesNegativeTest-556919386-project] Returning 404 to user: Volume 73959690-680d-45b3-8f5b-62c17cd456b5 could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:41:02.241816 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-81d2e53f-8d78-45c0-ac55-1f3f7c4b7fd5 tempest-VolumesNegativeTest-556919386 tempest-VolumesNegativeTest-556919386-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/73959690-680d-45b3-8f5b-62c17cd456b5" status: 404 len: 109 microversion: 2.1 time: 0.056918 May 26 16:41:02.242670 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 10/12] 10.222.0.102 () {58 vars in 1249 bytes} [Thu May 26 16:41:02 2022] GET /compute/v2.1/os-volumes/73959690-680d-45b3-8f5b-62c17cd456b5 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 16:41:02.945699 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-527250af-3b53-4a0e-900e-c2d53edd7454 tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] Calling method '.version_select at 0x7f93b24e40d0>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:03.088780 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-527250af-3b53-4a0e-900e-c2d53edd7454 tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/49d76927-e455-40b6-adbf-b9af63039985" status: 200 len: 345 microversion: 2.1 time: 0.156776 May 26 16:41:03.088780 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 11/13] 10.222.0.102 () {58 vars in 1249 bytes} [Thu May 26 16:41:02 2022] GET /compute/v2.1/os-volumes/49d76927-e455-40b6-adbf-b9af63039985 => generated 345 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:41:03.106621 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-cfe62759-b292-4c0b-b404-bdf4655f4571 tempest-VolumesTestJSON-1861020662 tempest-VolumesTestJSON-1861020662-project] Calling method '.version_select at 0x7f93b1b1a280>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:03.234649 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-cfe62759-b292-4c0b-b404-bdf4655f4571 tempest-VolumesTestJSON-1861020662 tempest-VolumesTestJSON-1861020662-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/3cfc936b-cc92-4709-814f-00e30a389eca" status: 200 len: 351 microversion: 2.1 time: 0.147039 May 26 16:41:03.235584 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 12/14] 10.222.0.102 () {58 vars in 1249 bytes} [Thu May 26 16:41:03 2022] GET /compute/v2.1/os-volumes/3cfc936b-cc92-4709-814f-00e30a389eca => generated 351 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:41:03.252737 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-40e252fb-3c10-45c0-9f9b-9da1394be05d tempest-VolumesGetTestJSON-1501673832 tempest-VolumesGetTestJSON-1501673832-project] Calling method '.version_select at 0x7f93b1b1aee0>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:03.469528 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-66dca667-6a6d-41cd-b244-1bbecc5554ec tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Flavor limits 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:41:03.471218 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-66dca667-6a6d-41cd-b244-1bbecc5554ec tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Image limits 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:41:03.472134 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-66dca667-6a6d-41cd-b244-1bbecc5554ec tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Flavor pref 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:41:03.472932 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-66dca667-6a6d-41cd-b244-1bbecc5554ec tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Image pref 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:41:03.476999 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-66dca667-6a6d-41cd-b244-1bbecc5554ec tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:41:03.485400 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-40e252fb-3c10-45c0-9f9b-9da1394be05d tempest-VolumesGetTestJSON-1501673832 tempest-VolumesGetTestJSON-1501673832-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/1fc6ff5f-6910-4cc8-a9b4-9ae232be649b" status: 200 len: 354 microversion: 2.1 time: 0.248614 May 26 16:41:03.495726 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 13/15] 10.222.0.102 () {58 vars in 1249 bytes} [Thu May 26 16:41:03 2022] GET /compute/v2.1/os-volumes/1fc6ff5f-6910-4cc8-a9b4-9ae232be649b => generated 354 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:41:03.503695 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ef7e9162-8855-40fc-a0b0-966c5720d458 tempest-VolumesGetTestJSON-1501673832 tempest-VolumesGetTestJSON-1501673832-project] Calling method '.version_select at 0x7f93b1aeb670>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:03.530886 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-66dca667-6a6d-41cd-b244-1bbecc5554ec tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:03.531342 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-66dca667-6a6d-41cd-b244-1bbecc5554ec tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:03.532522 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-66dca667-6a6d-41cd-b244-1bbecc5554ec tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:03.535310 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-66dca667-6a6d-41cd-b244-1bbecc5554ec tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:03.605223 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.quota [None req-66dca667-6a6d-41cd-b244-1bbecc5554ec tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Getting quotas for project 86b15e7956a347cba0b1dca0a45c8482. Resources: {'cores', 'instances', 'ram'} {{(pid=124267) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:41:03.619525 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.quota [None req-66dca667-6a6d-41cd-b244-1bbecc5554ec tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Getting quotas for user 20b7990551ac458cb94c8bc922152650 and project 86b15e7956a347cba0b1dca0a45c8482. Resources: {'cores', 'instances', 'ram'} {{(pid=124267) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:41:03.630857 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ef7e9162-8855-40fc-a0b0-966c5720d458 tempest-VolumesGetTestJSON-1501673832 tempest-VolumesGetTestJSON-1501673832-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/1fc6ff5f-6910-4cc8-a9b4-9ae232be649b" status: 200 len: 354 microversion: 2.1 time: 0.131917 May 26 16:41:03.631786 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 14/16] 10.222.0.102 () {58 vars in 1249 bytes} [Thu May 26 16:41:03 2022] GET /compute/v2.1/os-volumes/1fc6ff5f-6910-4cc8-a9b4-9ae232be649b => generated 354 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:41:03.650442 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-dc6c6e65-1f26-4494-b985-987023a2d3c1 tempest-VolumesGetTestJSON-1501673832 tempest-VolumesGetTestJSON-1501673832-project] Calling method '.version_select at 0x7f93b1b1a0d0>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:03.657059 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-66dca667-6a6d-41cd-b244-1bbecc5554ec tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Going to run 1 instances... {{(pid=124267) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:41:03.660223 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-66dca667-6a6d-41cd-b244-1bbecc5554ec tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d74c4a51-21fe-41d5-865a-cb93604ac3aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:41:03.820868 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-66dca667-6a6d-41cd-b244-1bbecc5554ec tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.080284 May 26 16:41:03.821822 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 3/17] 10.222.0.102 () {60 vars in 1151 bytes} [Thu May 26 16:41:01 2022] POST /compute/v2.1/servers => generated 382 bytes in 2083 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 16:41:03.832655 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-b0b526b8-ff8c-4acd-8188-e92cab7a1ee7 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:03.833279 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-b0b526b8-ff8c-4acd-8188-e92cab7a1ee7 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:03.881668 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-dc6c6e65-1f26-4494-b985-987023a2d3c1 tempest-VolumesGetTestJSON-1501673832 tempest-VolumesGetTestJSON-1501673832-project] 10.222.0.102 "DELETE /compute/v2.1/os-volumes/1fc6ff5f-6910-4cc8-a9b4-9ae232be649b" status: 202 len: 0 microversion: 2.1 time: 0.237027 May 26 16:41:03.883500 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 15/18] 10.222.0.102 () {58 vars in 1252 bytes} [Thu May 26 16:41:03 2022] DELETE /compute/v2.1/os-volumes/1fc6ff5f-6910-4cc8-a9b4-9ae232be649b => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 16:41:03.891814 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-42acef0a-7436-4ca3-ba4e-7836659a4a9e tempest-VolumesGetTestJSON-1501673832 tempest-VolumesGetTestJSON-1501673832-project] Calling method '.version_select at 0x7f93b24e4280>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:04.038016 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-42acef0a-7436-4ca3-ba4e-7836659a4a9e tempest-VolumesGetTestJSON-1501673832 tempest-VolumesGetTestJSON-1501673832-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/1fc6ff5f-6910-4cc8-a9b4-9ae232be649b" status: 200 len: 353 microversion: 2.1 time: 0.150112 May 26 16:41:04.038948 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 16/19] 10.222.0.102 () {58 vars in 1249 bytes} [Thu May 26 16:41:03 2022] GET /compute/v2.1/os-volumes/1fc6ff5f-6910-4cc8-a9b4-9ae232be649b => generated 353 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:41:04.098834 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-35c3069c-2f92-4931-a67f-f1b8de740550 tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] Calling method '.version_select at 0x7f93b1b62ee0>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:04.155926 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-b0b526b8-ff8c-4acd-8188-e92cab7a1ee7 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:04.186563 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-b0b526b8-ff8c-4acd-8188-e92cab7a1ee7 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1219 microversion: 2.1 time: 0.357991 May 26 16:41:04.187701 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 4/20] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:03 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1219 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:41:04.203978 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-35c3069c-2f92-4931-a67f-f1b8de740550 tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/49d76927-e455-40b6-adbf-b9af63039985" status: 200 len: 346 microversion: 2.1 time: 0.109140 May 26 16:41:04.204635 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 17/21] 10.222.0.102 () {58 vars in 1249 bytes} [Thu May 26 16:41:04 2022] GET /compute/v2.1/os-volumes/49d76927-e455-40b6-adbf-b9af63039985 => generated 346 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:41:04.221763 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-b657b6e9-b2d3-4d99-8f81-7ad8f26416e6 tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] Action: 'create', calling method: .version_select at 0x7f93b09c9f70>, body: {"snapshot": {"volume_id": "49d76927-e455-40b6-adbf-b9af63039985", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1904207972"}} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:41:04.751205 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-b657b6e9-b2d3-4d99-8f81-7ad8f26416e6 tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] 10.222.0.102 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.533345 May 26 16:41:04.753220 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 5/22] 10.222.0.102 () {60 vars in 1166 bytes} [Thu May 26 16:41:04 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:41:04.763257 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-c83fb874-3dd4-4f2c-bac1-f365766fe0bc tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] Calling method '.version_select at 0x7f93b1aeb430>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:04.952133 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-c83fb874-3dd4-4f2c-bac1-f365766fe0bc tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] 10.222.0.102 "GET /compute/v2.1/os-snapshots/46e8e975-30a6-4bb4-8ac3-a65bc49b9db9" status: 200 len: 287 microversion: 2.1 time: 0.192924 May 26 16:41:04.953261 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 18/23] 10.222.0.102 () {58 vars in 1255 bytes} [Thu May 26 16:41:04 2022] GET /compute/v2.1/os-snapshots/46e8e975-30a6-4bb4-8ac3-a65bc49b9db9 => generated 287 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:41:04.964427 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-6e576592-3619-4eb8-ae8d-2bc1d8fc8c1d tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] Calling method '.version_select at 0x7f93b1bd4b80>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:05.046537 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-6e576592-3619-4eb8-ae8d-2bc1d8fc8c1d tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] 10.222.0.102 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.086411 May 26 16:41:05.047152 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 6/24] 10.222.0.102 () {58 vars in 1144 bytes} [Thu May 26 16:41:04 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:41:05.058787 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f79a07d5-254c-4fca-b6a5-1395c96f9d8b tempest-VolumesGetTestJSON-1501673832 tempest-VolumesGetTestJSON-1501673832-project] Calling method '.version_select at 0x7f93b24e4310>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:05.060268 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-7781c67d-f964-4272-b2b5-288cc644d3e7 tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] Calling method '.version_select at 0x7f93b09c8a60>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:05.130197 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-7781c67d-f964-4272-b2b5-288cc644d3e7 tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] 10.222.0.102 "GET /compute/v2.1/os-snapshots/46e8e975-30a6-4bb4-8ac3-a65bc49b9db9" status: 200 len: 287 microversion: 2.1 time: 0.075462 May 26 16:41:05.131065 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 7/25] 10.222.0.102 () {58 vars in 1255 bytes} [Thu May 26 16:41:05 2022] GET /compute/v2.1/os-snapshots/46e8e975-30a6-4bb4-8ac3-a65bc49b9db9 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:41:05.159028 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-dae66253-3caf-4fc7-be63-f737cf348e7d tempest-VolumesTestJSON-1861020662 tempest-VolumesTestJSON-1861020662-project] Calling method '.version_select at 0x7f93b09e2160>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:05.199764 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-f79a07d5-254c-4fca-b6a5-1395c96f9d8b tempest-VolumesGetTestJSON-1501673832 tempest-VolumesGetTestJSON-1501673832-project] HTTP exception thrown: Volume 1fc6ff5f-6910-4cc8-a9b4-9ae232be649b could not be found. May 26 16:41:05.202023 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f79a07d5-254c-4fca-b6a5-1395c96f9d8b tempest-VolumesGetTestJSON-1501673832 tempest-VolumesGetTestJSON-1501673832-project] Request method failure captured: May 26 16:41:05.202023 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/os-volumes/1fc6ff5f-6910-4cc8-a9b4-9ae232be649b HTTP/1.1 May 26 16:41:05.202023 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept: application/json May 26 16:41:05.202023 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity May 26 16:41:05.202023 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Connection: close May 26 16:41:05.202023 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Length: 0 May 26 16:41:05.202023 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Type: application/json May 26 16:41:05.202023 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Host: 10.222.0.102 May 26 16:41:05.202023 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None May 26 16:41:05.202023 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 May 26 16:41:05.202023 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABij62bqGMfxj8gKGbtF4M0_7cBo2gOHLiNKWIdMP-rLgIfm7G_sHbiZs_g2gDscL0rcAD0JQyV86mg86sZB8qhNdxC3bn62zHAi9ImnpDIo8Cq6iFRB9k_yxuA94wz8SPBdwXiRe7xFOmkI11qoPoeP_L6KP8hX1GeeOhxmZ95Wa9MXOw May 26 16:41:05.202023 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Id: None May 26 16:41:05.202023 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Name: None May 26 16:41:05.202023 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed May 26 16:41:05.202023 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True May 26 16:41:05.202023 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default May 26 16:41:05.202023 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default May 26 16:41:05.202023 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Id: adace30fd6d94630a8bbf637826c4cfe May 26 16:41:05.202023 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-VolumesGetTestJSON-1501673832 May 26 16:41:05.202023 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Role: reader,member May 26 16:41:05.202023 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Roles: reader,member May 26 16:41:05.203347 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/adace30fd6d94630a8bbf637826c4cfe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/adace30fd6d94630a8bbf637826c4cfe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/adace30fd6d94630a8bbf637826c4cfe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_adace30fd6d94630a8bbf637826c4cfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:41:05.203347 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-VolumesGetTestJSON-1501673832 May 26 16:41:05.203347 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Id: adace30fd6d94630a8bbf637826c4cfe May 26 16:41:05.203347 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-VolumesGetTestJSON-1501673832 May 26 16:41:05.203347 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User: tempest-VolumesGetTestJSON-1501673832-project May 26 16:41:05.203347 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default May 26 16:41:05.203347 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default May 26 16:41:05.203347 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Id: bd98a8a14cf44e3ba2680a230f0cab7a May 26 16:41:05.203347 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-VolumesGetTestJSON-1501673832-project May 26 16:41:05.203347 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: method: May 26 16:41:05.203347 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: exception: Volume 1fc6ff5f-6910-4cc8-a9b4-9ae232be649b could not be found. May 26 16:41:05.203347 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: action_args: {'id': '1fc6ff5f-6910-4cc8-a9b4-9ae232be649b'} May 26 16:41:05.203347 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:41:05.204143 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:05.204143 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 16:41:05.204143 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 16:41:05.204143 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 16:41:05.204143 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 16:41:05.204143 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 16:41:05.204143 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 16:41:05.204143 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 16:41:05.204143 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 16:41:05.204143 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 16:41:05.204143 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 16:41:05.204143 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 16:41:05.204143 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 16:41:05.204143 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 16:41:05.204143 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 16:41:05.204143 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1fc6ff5f-6910-4cc8-a9b4-9ae232be649b could not be found. (HTTP 404) (Request-ID: req-071f54be-aa5e-4cea-9a74-c25062a04bf9) May 26 16:41:05.204143 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:05.204143 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:41:05.204143 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:05.205176 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:05.205176 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 16:41:05.205176 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 16:41:05.205176 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 16:41:05.205176 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 16:41:05.205176 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 16:41:05.205176 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 16:41:05.205176 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 16:41:05.205176 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 16:41:05.205176 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 16:41:05.205176 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 16:41:05.205176 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 16:41:05.205176 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 16:41:05.205176 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 16:41:05.205176 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 16:41:05.205176 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 16:41:05.205176 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 16:41:05.205176 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 16:41:05.205176 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 16:41:05.206298 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 16:41:05.206298 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 16:41:05.206298 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 16:41:05.206298 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 16:41:05.206298 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1fc6ff5f-6910-4cc8-a9b4-9ae232be649b could not be found. May 26 16:41:05.206298 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:05.206298 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:41:05.206298 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:05.206298 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:05.206298 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:41:05.206298 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:41:05.206298 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:41:05.206298 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:41:05.206298 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 16:41:05.206298 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 16:41:05.206298 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:41:05.206298 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:41:05.206298 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 16:41:05.206298 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:41:05.207346 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1fc6ff5f-6910-4cc8-a9b4-9ae232be649b could not be found. May 26 16:41:05.207346 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:05.207346 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:41:05.207346 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:05.207346 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:05.207346 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:41:05.207346 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:41:05.207346 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:41:05.207346 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:41:05.207346 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1fc6ff5f-6910-4cc8-a9b4-9ae232be649b could not be found. May 26 16:41:05.207346 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:05.207346 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f79a07d5-254c-4fca-b6a5-1395c96f9d8b tempest-VolumesGetTestJSON-1501673832 tempest-VolumesGetTestJSON-1501673832-project] Returning 404 to user: Volume 1fc6ff5f-6910-4cc8-a9b4-9ae232be649b could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:41:05.207346 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f79a07d5-254c-4fca-b6a5-1395c96f9d8b tempest-VolumesGetTestJSON-1501673832 tempest-VolumesGetTestJSON-1501673832-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/1fc6ff5f-6910-4cc8-a9b4-9ae232be649b" status: 404 len: 109 microversion: 2.1 time: 0.156228 May 26 16:41:05.207346 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 19/26] 10.222.0.102 () {58 vars in 1249 bytes} [Thu May 26 16:41:05 2022] GET /compute/v2.1/os-volumes/1fc6ff5f-6910-4cc8-a9b4-9ae232be649b => generated 109 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 16:41:05.224897 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3301ed61-e12f-4e68-8823-23f376845c3f tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:05.225751 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-3301ed61-e12f-4e68-8823-23f376845c3f tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:05.286665 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-dae66253-3caf-4fc7-be63-f737cf348e7d tempest-VolumesTestJSON-1861020662 tempest-VolumesTestJSON-1861020662-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/a6206088-53b4-4503-a819-48cec417c34a" status: 200 len: 351 microversion: 2.1 time: 0.131428 May 26 16:41:05.287679 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 8/27] 10.222.0.102 () {58 vars in 1249 bytes} [Thu May 26 16:41:05 2022] GET /compute/v2.1/os-volumes/a6206088-53b4-4503-a819-48cec417c34a => generated 351 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:41:05.546210 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3301ed61-e12f-4e68-8823-23f376845c3f tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:05.587714 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-3301ed61-e12f-4e68-8823-23f376845c3f tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1219 microversion: 2.1 time: 0.372197 May 26 16:41:05.597713 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 20/28] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:05 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1219 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:06.142782 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-22900d2a-3aaa-4acd-98e9-f9ec17f800fe tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] Calling method '.version_select at 0x7f93b09c8af0>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:06.222259 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-22900d2a-3aaa-4acd-98e9-f9ec17f800fe tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] 10.222.0.102 "GET /compute/v2.1/os-snapshots/46e8e975-30a6-4bb4-8ac3-a65bc49b9db9" status: 200 len: 287 microversion: 2.1 time: 0.082692 May 26 16:41:06.223426 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 9/29] 10.222.0.102 () {58 vars in 1255 bytes} [Thu May 26 16:41:06 2022] GET /compute/v2.1/os-snapshots/46e8e975-30a6-4bb4-8ac3-a65bc49b9db9 => generated 287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:41:06.634196 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2aefbe9e-f13d-42f9-a9c8-4d4b10ae6896 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:06.635801 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2aefbe9e-f13d-42f9-a9c8-4d4b10ae6896 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:06.651420 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2aefbe9e-f13d-42f9-a9c8-4d4b10ae6896 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:06.661176 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2aefbe9e-f13d-42f9-a9c8-4d4b10ae6896 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:06.662275 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2aefbe9e-f13d-42f9-a9c8-4d4b10ae6896 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:06.663983 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2aefbe9e-f13d-42f9-a9c8-4d4b10ae6896 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:07.144505 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-2aefbe9e-f13d-42f9-a9c8-4d4b10ae6896 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:07.164424 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2aefbe9e-f13d-42f9-a9c8-4d4b10ae6896 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1223 microversion: 2.1 time: 0.535101 May 26 16:41:07.170415 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 21/30] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:06 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1223 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:07.243971 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-c3aac881-7433-4fa1-9059-64c8ff28e26a tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] Calling method '.version_select at 0x7f93b09c8280>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:07.341771 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-c3aac881-7433-4fa1-9059-64c8ff28e26a tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] 10.222.0.102 "GET /compute/v2.1/os-snapshots/46e8e975-30a6-4bb4-8ac3-a65bc49b9db9" status: 200 len: 287 microversion: 2.1 time: 0.111183 May 26 16:41:07.343448 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 10/31] 10.222.0.102 () {58 vars in 1255 bytes} [Thu May 26 16:41:07 2022] GET /compute/v2.1/os-snapshots/46e8e975-30a6-4bb4-8ac3-a65bc49b9db9 => generated 287 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:41:08.185981 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f4c650a8-9b88-49d7-bb6b-bfa7cdc9fc9e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:08.187382 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f4c650a8-9b88-49d7-bb6b-bfa7cdc9fc9e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:08.197332 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f4c650a8-9b88-49d7-bb6b-bfa7cdc9fc9e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:08.200972 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f4c650a8-9b88-49d7-bb6b-bfa7cdc9fc9e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:08.209177 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f4c650a8-9b88-49d7-bb6b-bfa7cdc9fc9e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:08.212398 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f4c650a8-9b88-49d7-bb6b-bfa7cdc9fc9e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:08.355693 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-6aa39b32-6d41-4c73-9c20-69fc304290a8 tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] Calling method '.version_select at 0x7f93b1bd4940>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:08.389090 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f4c650a8-9b88-49d7-bb6b-bfa7cdc9fc9e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:08.407036 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-6aa39b32-6d41-4c73-9c20-69fc304290a8 tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] 10.222.0.102 "GET /compute/v2.1/os-snapshots/46e8e975-30a6-4bb4-8ac3-a65bc49b9db9" status: 200 len: 287 microversion: 2.1 time: 0.056211 May 26 16:41:08.407223 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f4c650a8-9b88-49d7-bb6b-bfa7cdc9fc9e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1223 microversion: 2.1 time: 0.224627 May 26 16:41:08.407697 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 22/32] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:08 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1223 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:08.408134 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 11/33] 10.222.0.102 () {58 vars in 1255 bytes} [Thu May 26 16:41:08 2022] GET /compute/v2.1/os-snapshots/46e8e975-30a6-4bb4-8ac3-a65bc49b9db9 => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:41:09.420394 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d7331daf-7312-4890-8f5e-745e49ef1d27 tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] Calling method '.version_select at 0x7f93b1a23550>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:09.426615 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-d63c5890-b114-4843-9fe2-83792c8a60cb tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:09.427343 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-d63c5890-b114-4843-9fe2-83792c8a60cb tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:09.437810 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d63c5890-b114-4843-9fe2-83792c8a60cb tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:09.438778 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d63c5890-b114-4843-9fe2-83792c8a60cb tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:09.443900 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d63c5890-b114-4843-9fe2-83792c8a60cb tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:09.444495 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d63c5890-b114-4843-9fe2-83792c8a60cb tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:09.494167 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d7331daf-7312-4890-8f5e-745e49ef1d27 tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] 10.222.0.102 "GET /compute/v2.1/os-snapshots/46e8e975-30a6-4bb4-8ac3-a65bc49b9db9" status: 200 len: 287 microversion: 2.1 time: 0.078280 May 26 16:41:09.495839 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 23/34] 10.222.0.102 () {58 vars in 1255 bytes} [Thu May 26 16:41:09 2022] GET /compute/v2.1/os-snapshots/46e8e975-30a6-4bb4-8ac3-a65bc49b9db9 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:41:09.935962 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-d63c5890-b114-4843-9fe2-83792c8a60cb tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:09.951903 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-d63c5890-b114-4843-9fe2-83792c8a60cb tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1223 microversion: 2.1 time: 0.529256 May 26 16:41:09.962690 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 12/35] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:09 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1223 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:10.508285 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-24500f2f-0892-462d-9f14-e25b59498940 tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] Calling method '.version_select at 0x7f93b09c80d0>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:10.532277 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1e531a43-7183-4bfd-afe4-d9d739425b58 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Action: 'create', calling method: .version_select at 0x7f93b1b1a160>, body: {"keypair": {"name": "tempest-keypair-1583566214", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrowMz6gNCeLaGQ2STA4PIF85uVKTpypxcuGLgriVA9fXwKtu/lB/RoEggexJMgt4cj4t8HxAoEqU5Jab17IN/Any27NnRG/gBRFCHHYVzoahAwCGKePLHcYbw8V6sLBQ=="}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:41:10.569553 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-24500f2f-0892-462d-9f14-e25b59498940 tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] 10.222.0.102 "GET /compute/v2.1/os-snapshots/46e8e975-30a6-4bb4-8ac3-a65bc49b9db9" status: 200 len: 287 microversion: 2.1 time: 0.066921 May 26 16:41:10.570120 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 13/36] 10.222.0.102 () {58 vars in 1255 bytes} [Thu May 26 16:41:10 2022] GET /compute/v2.1/os-snapshots/46e8e975-30a6-4bb4-8ac3-a65bc49b9db9 => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:41:10.648286 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-1e531a43-7183-4bfd-afe4-d9d739425b58 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Getting quotas for project a69cba8eb64f4fcc87bbc6960a0abeb0. Resources: {'key_pairs'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:41:10.670711 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-1e531a43-7183-4bfd-afe4-d9d739425b58 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Getting quotas for user e4941664ae624d4190ff53e5965db33f and project a69cba8eb64f4fcc87bbc6960a0abeb0. Resources: {'key_pairs'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:41:10.800272 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1e531a43-7183-4bfd-afe4-d9d739425b58 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.727473 May 26 16:41:10.800939 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 24/37] 10.222.0.102 () {62 vars in 1204 bytes} [Thu May 26 16:41:10 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 729 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 26 16:41:10.970957 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-5524cf7a-3655-408b-be89-83db80d4d23b tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:10.971530 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-5524cf7a-3655-408b-be89-83db80d4d23b tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:10.987378 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-5524cf7a-3655-408b-be89-83db80d4d23b tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:10.988462 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-5524cf7a-3655-408b-be89-83db80d4d23b tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:10.991155 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-5524cf7a-3655-408b-be89-83db80d4d23b tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:10.991628 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-5524cf7a-3655-408b-be89-83db80d4d23b tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:11.144322 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-5524cf7a-3655-408b-be89-83db80d4d23b tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:11.156683 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-5524cf7a-3655-408b-be89-83db80d4d23b tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1223 microversion: 2.1 time: 0.190017 May 26 16:41:11.160507 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 14/38] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:10 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1223 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:11.582794 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-bf26e005-e643-45c5-9779-6163282ba450 tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] Calling method '.version_select at 0x7f93b19b4e50>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:11.642232 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-bf26e005-e643-45c5-9779-6163282ba450 tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] 10.222.0.102 "GET /compute/v2.1/os-snapshots/46e8e975-30a6-4bb4-8ac3-a65bc49b9db9" status: 200 len: 287 microversion: 2.1 time: 0.064213 May 26 16:41:11.647191 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 25/39] 10.222.0.102 () {58 vars in 1255 bytes} [Thu May 26 16:41:11 2022] GET /compute/v2.1/os-snapshots/46e8e975-30a6-4bb4-8ac3-a65bc49b9db9 => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:41:12.177821 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-624bd78e-a41d-4304-bbd8-b77d6d463b4e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:12.179179 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-624bd78e-a41d-4304-bbd8-b77d6d463b4e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:12.191812 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-624bd78e-a41d-4304-bbd8-b77d6d463b4e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:12.195080 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-624bd78e-a41d-4304-bbd8-b77d6d463b4e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:12.196224 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-624bd78e-a41d-4304-bbd8-b77d6d463b4e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:12.198764 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-624bd78e-a41d-4304-bbd8-b77d6d463b4e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:12.670582 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-c8b48974-8703-4daa-9bca-02a13ac21afc tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] Calling method '.version_select at 0x7f93b196f550>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:12.769725 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-624bd78e-a41d-4304-bbd8-b77d6d463b4e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:12.798762 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-624bd78e-a41d-4304-bbd8-b77d6d463b4e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1279 microversion: 2.1 time: 0.626448 May 26 16:41:12.802594 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 15/40] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:12 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1279 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:12.825114 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-c8b48974-8703-4daa-9bca-02a13ac21afc tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] 10.222.0.102 "GET /compute/v2.1/os-snapshots/46e8e975-30a6-4bb4-8ac3-a65bc49b9db9" status: 200 len: 288 microversion: 2.1 time: 0.171133 May 26 16:41:12.825897 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 26/41] 10.222.0.102 () {58 vars in 1255 bytes} [Thu May 26 16:41:12 2022] GET /compute/v2.1/os-snapshots/46e8e975-30a6-4bb4-8ac3-a65bc49b9db9 => generated 288 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:41:12.844865 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-b3ed7fc5-abf7-44c8-8c4c-c0aa4e03f6ae tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] Calling method '.version_select at 0x7f93b09c80d0>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:13.066005 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-b3ed7fc5-abf7-44c8-8c4c-c0aa4e03f6ae tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] 10.222.0.102 "DELETE /compute/v2.1/os-snapshots/46e8e975-30a6-4bb4-8ac3-a65bc49b9db9" status: 202 len: 0 microversion: 2.1 time: 0.227229 May 26 16:41:13.066979 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 16/42] 10.222.0.102 () {58 vars in 1258 bytes} [Thu May 26 16:41:12 2022] DELETE /compute/v2.1/os-snapshots/46e8e975-30a6-4bb4-8ac3-a65bc49b9db9 => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 16:41:13.078268 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-cf35183c-18d6-4a6f-9191-1f71edc7daea tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] Calling method '.version_select at 0x7f93b094eaf0>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:13.190262 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-cf35183c-18d6-4a6f-9191-1f71edc7daea tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] 10.222.0.102 "GET /compute/v2.1/os-snapshots/46e8e975-30a6-4bb4-8ac3-a65bc49b9db9" status: 200 len: 287 microversion: 2.1 time: 0.117513 May 26 16:41:13.190947 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 17/43] 10.222.0.102 () {58 vars in 1255 bytes} [Thu May 26 16:41:13 2022] GET /compute/v2.1/os-snapshots/46e8e975-30a6-4bb4-8ac3-a65bc49b9db9 => generated 287 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:41:13.220757 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-2bf422b5-a35b-425e-ab56-8b77cba5dfc0 tempest-VolumesTestJSON-1861020662 tempest-VolumesTestJSON-1861020662-project] Calling method '.version_select at 0x7f93b0929670>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:13.380512 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-2bf422b5-a35b-425e-ab56-8b77cba5dfc0 tempest-VolumesTestJSON-1861020662 tempest-VolumesTestJSON-1861020662-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/6703bbc8-2e58-46bf-b06b-039cf71b089b" status: 200 len: 350 microversion: 2.1 time: 0.163575 May 26 16:41:13.387994 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 18/44] 10.222.0.102 () {58 vars in 1249 bytes} [Thu May 26 16:41:13 2022] GET /compute/v2.1/os-volumes/6703bbc8-2e58-46bf-b06b-039cf71b089b => generated 350 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:41:13.393095 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-815f0695-0c85-4cb1-91be-900ee5c3ae08 tempest-VolumesTestJSON-1861020662 tempest-VolumesTestJSON-1861020662-project] Calling method '.version_select at 0x7f93b094e940>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:13.561102 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell0:SELECT=2 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:13.585513 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-815f0695-0c85-4cb1-91be-900ee5c3ae08 tempest-VolumesTestJSON-1861020662 tempest-VolumesTestJSON-1861020662-project] 10.222.0.102 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.196154 May 26 16:41:13.586148 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 19/45] 10.222.0.102 () {58 vars in 1138 bytes} [Thu May 26 16:41:13 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:13.600843 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-7fd16c80-a2f0-4702-a5b7-d71145b93daf tempest-VolumesTestJSON-1861020662 tempest-VolumesTestJSON-1861020662-project] Calling method '.version_select at 0x7f93b09594c0>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:13.789276 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-7fd16c80-a2f0-4702-a5b7-d71145b93daf tempest-VolumesTestJSON-1861020662 tempest-VolumesTestJSON-1861020662-project] 10.222.0.102 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.194434 May 26 16:41:13.801799 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 20/46] 10.222.0.102 () {58 vars in 1153 bytes} [Thu May 26 16:41:13 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:41:13.811947 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-322016d7-2023-4c73-8099-cd6458b337f1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-221555123", "imageRef": "d74c4a51-21fe-41d5-865a-cb93604ac3aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:41:13.816266 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-746d6a9a-eef3-497e-8b33-433558be9b4b tempest-VolumesTestJSON-1861020662 tempest-VolumesTestJSON-1861020662-project] Calling method '.version_select at 0x7f93b0929790>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:13.952115 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-746d6a9a-eef3-497e-8b33-433558be9b4b tempest-VolumesTestJSON-1861020662 tempest-VolumesTestJSON-1861020662-project] 10.222.0.102 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.148262 May 26 16:41:13.953544 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 21/47] 10.222.0.102 () {58 vars in 1138 bytes} [Thu May 26 16:41:13 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:13.959883 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-4dcaed3f-b4d6-4d9b-a57d-d6713e176ee6 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:13.965447 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-4dcaed3f-b4d6-4d9b-a57d-d6713e176ee6 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:13.976539 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4dcaed3f-b4d6-4d9b-a57d-d6713e176ee6 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:13.978368 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4dcaed3f-b4d6-4d9b-a57d-d6713e176ee6 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:13.984154 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.network.neutron [None req-322016d7-2023-4c73-8099-cd6458b337f1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] validate_networks() for [('e8532e65-4cfe-4ff7-9b7e-e643c5e1e677', None, None, None, None, None)] {{(pid=124266) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:41:13.987143 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4dcaed3f-b4d6-4d9b-a57d-d6713e176ee6 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:13.989538 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4dcaed3f-b4d6-4d9b-a57d-d6713e176ee6 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:14.185880 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell0:SELECT=8 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:15.994449 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-4dcaed3f-b4d6-4d9b-a57d-d6713e176ee6 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:16.014282 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-4dcaed3f-b4d6-4d9b-a57d-d6713e176ee6 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1319 microversion: 2.1 time: 2.058616 May 26 16:41:16.024232 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 22/48] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:13 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1319 bytes in 2065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:16.046312 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-a3f86d67-a8d3-4f67-8df4-e6e85180af34 tempest-VolumesTestJSON-1861020662 tempest-VolumesTestJSON-1861020662-project] Calling method '.version_select at 0x7f93b094ec10>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:16.403215 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-a3f86d67-a8d3-4f67-8df4-e6e85180af34 tempest-VolumesTestJSON-1861020662 tempest-VolumesTestJSON-1861020662-project] 10.222.0.102 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.377458 May 26 16:41:16.403868 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 23/49] 10.222.0.102 () {58 vars in 1171 bytes} [Thu May 26 16:41:16 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:41:16.409360 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-dd3e9eac-ef13-45b2-8e8d-a29876542c8a tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] Calling method '.version_select at 0x7f93b09290d0>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:16.466165 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.wsgi [None req-dd3e9eac-ef13-45b2-8e8d-a29876542c8a tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] HTTP exception thrown: Snapshot 46e8e975-30a6-4bb4-8ac3-a65bc49b9db9 could not be found. May 26 16:41:16.471743 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-dd3e9eac-ef13-45b2-8e8d-a29876542c8a tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] Request method failure captured: May 26 16:41:16.471743 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: request: GET /compute/v2.1/os-snapshots/46e8e975-30a6-4bb4-8ac3-a65bc49b9db9 HTTP/1.1 May 26 16:41:16.471743 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept: application/json May 26 16:41:16.471743 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept-Encoding: identity May 26 16:41:16.471743 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Connection: close May 26 16:41:16.471743 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Length: 0 May 26 16:41:16.471743 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Type: application/json May 26 16:41:16.471743 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Host: 10.222.0.102 May 26 16:41:16.471743 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Openstack-System-Scope: None May 26 16:41:16.471743 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: User-Agent: python-urllib3/1.26.9 May 26 16:41:16.471743 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Auth-Token: gAAAAABij62bygB317E0QeHfFFgE0wJV3BhkH9sL13Xt7DASnCGIZWoowT2MEGkHiDJjWB3j_XwDyIeNb706600C-ChBo0XSrJ5e8Brh1PQyM_4EIlLh4v0IyCio3gk0TpyjicYJnfZzPftQlmlXGlt5wP_VtqKs8jQohnntz0Gl8JGLZ-FLywM May 26 16:41:16.471743 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Id: None May 26 16:41:16.471743 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Name: None May 26 16:41:16.471743 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Identity-Status: Confirmed May 26 16:41:16.471743 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Is-Admin-Project: True May 26 16:41:16.471743 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Id: default May 26 16:41:16.471743 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Name: Default May 26 16:41:16.471743 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Id: f7449f3a96c8444a8efdb118290cc4e0 May 26 16:41:16.471743 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-143745927 May 26 16:41:16.471743 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Role: reader,member May 26 16:41:16.471743 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Roles: reader,member May 26 16:41:16.473071 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/f7449f3a96c8444a8efdb118290cc4e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/f7449f3a96c8444a8efdb118290cc4e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/f7449f3a96c8444a8efdb118290cc4e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_f7449f3a96c8444a8efdb118290cc4e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:41:16.473071 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant: tempest-VolumesSnapshotsTestJSON-143745927 May 26 16:41:16.473071 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Id: f7449f3a96c8444a8efdb118290cc4e0 May 26 16:41:16.473071 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-143745927 May 26 16:41:16.473071 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User: tempest-VolumesSnapshotsTestJSON-143745927-project May 26 16:41:16.473071 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Id: default May 26 16:41:16.473071 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Name: Default May 26 16:41:16.473071 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Id: 602566fb23bc463c834d92cdc035fbd7 May 26 16:41:16.473071 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Name: tempest-VolumesSnapshotsTestJSON-143745927-project May 26 16:41:16.473071 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: method: May 26 16:41:16.473071 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: exception: Snapshot 46e8e975-30a6-4bb4-8ac3-a65bc49b9db9 could not be found. May 26 16:41:16.473071 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: action_args: {'id': '46e8e975-30a6-4bb4-8ac3-a65bc49b9db9'} May 26 16:41:16.473071 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:41:16.473758 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:16.473758 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 26 16:41:16.473758 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 26 16:41:16.473758 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 26 16:41:16.473758 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 26 16:41:16.473758 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 26 16:41:16.473758 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 26 16:41:16.473758 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 16:41:16.473758 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 16:41:16.473758 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 16:41:16.473758 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 16:41:16.473758 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 16:41:16.473758 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 16:41:16.473758 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 16:41:16.473758 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 16:41:16.473758 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 46e8e975-30a6-4bb4-8ac3-a65bc49b9db9 could not be found. (HTTP 404) (Request-ID: req-d4a758a8-df65-430e-8c2b-3fb9dfec170d) May 26 16:41:16.473758 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:41:16.473758 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:41:16.474659 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:41:16.474659 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:16.474659 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 26 16:41:16.474659 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 26 16:41:16.474659 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 16:41:16.474659 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 16:41:16.474659 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 26 16:41:16.474659 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 26 16:41:16.474659 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 16:41:16.474659 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 16:41:16.474659 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 26 16:41:16.474659 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 26 16:41:16.474659 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 26 16:41:16.474659 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 26 16:41:16.474659 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 26 16:41:16.474659 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 26 16:41:16.474659 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 16:41:16.474659 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 16:41:16.474659 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 16:41:16.476270 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 16:41:16.476270 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 16:41:16.476270 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 16:41:16.476270 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 16:41:16.476270 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 16:41:16.476270 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 46e8e975-30a6-4bb4-8ac3-a65bc49b9db9 could not be found. May 26 16:41:16.476270 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:41:16.476270 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:41:16.476270 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:41:16.476270 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:16.476270 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:41:16.476270 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:41:16.476270 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:41:16.476270 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:41:16.476270 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 16:41:16.476270 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 16:41:16.476270 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:41:16.476270 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:41:16.476270 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 26 16:41:16.476270 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:41:16.479388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 46e8e975-30a6-4bb4-8ac3-a65bc49b9db9 could not be found. May 26 16:41:16.479388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:41:16.479388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:41:16.479388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:41:16.479388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:16.479388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:41:16.479388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:41:16.479388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:41:16.479388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:41:16.479388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 46e8e975-30a6-4bb4-8ac3-a65bc49b9db9 could not be found. May 26 16:41:16.479388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:41:16.479388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-dd3e9eac-ef13-45b2-8e8d-a29876542c8a tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] Returning 404 to user: Snapshot 46e8e975-30a6-4bb4-8ac3-a65bc49b9db9 could not be found. {{(pid=124267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:41:16.479388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-dd3e9eac-ef13-45b2-8e8d-a29876542c8a tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] 10.222.0.102 "GET /compute/v2.1/os-snapshots/46e8e975-30a6-4bb4-8ac3-a65bc49b9db9" status: 404 len: 111 microversion: 2.1 time: 0.068828 May 26 16:41:16.479388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 24/50] 10.222.0.102 () {58 vars in 1255 bytes} [Thu May 26 16:41:16 2022] GET /compute/v2.1/os-snapshots/46e8e975-30a6-4bb4-8ac3-a65bc49b9db9 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 16:41:16.511433 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-9a2fb0f3-d434-4040-a35f-e21a48cbc7e3 tempest-VolumesTestJSON-1861020662 tempest-VolumesTestJSON-1861020662-project] Calling method '.version_select at 0x7f93b0929ee0>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:16.733309 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-9a2fb0f3-d434-4040-a35f-e21a48cbc7e3 tempest-VolumesTestJSON-1861020662 tempest-VolumesTestJSON-1861020662-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.251331 May 26 16:41:16.735719 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 25/51] 10.222.0.102 () {58 vars in 1174 bytes} [Thu May 26 16:41:16 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:41:16.751106 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-50fb9e76-d27a-4ef5-a5fe-7321db083c2f tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] Calling method '.version_select at 0x7f93b0940940>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:16.892454 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-50fb9e76-d27a-4ef5-a5fe-7321db083c2f tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] 10.222.0.102 "DELETE /compute/v2.1/os-volumes/49d76927-e455-40b6-adbf-b9af63039985" status: 202 len: 0 microversion: 2.1 time: 0.156696 May 26 16:41:16.893145 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 26/52] 10.222.0.102 () {58 vars in 1252 bytes} [Thu May 26 16:41:16 2022] DELETE /compute/v2.1/os-volumes/49d76927-e455-40b6-adbf-b9af63039985 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 16:41:16.904482 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-322016d7-2023-4c73-8099-cd6458b337f1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Flavor limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:41:16.905039 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-322016d7-2023-4c73-8099-cd6458b337f1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Image limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:41:16.905460 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-322016d7-2023-4c73-8099-cd6458b337f1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Flavor pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:41:16.906103 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-322016d7-2023-4c73-8099-cd6458b337f1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Image pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:41:16.906735 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-322016d7-2023-4c73-8099-cd6458b337f1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:41:16.910416 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-01dbadbc-b50b-4f71-9199-f138baaf81ba tempest-VolumesTestJSON-1861020662 tempest-VolumesTestJSON-1861020662-project] Calling method '.version_select at 0x7f93b08cc670>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:16.941534 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-322016d7-2023-4c73-8099-cd6458b337f1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:16.942289 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-322016d7-2023-4c73-8099-cd6458b337f1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:16.948782 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-322016d7-2023-4c73-8099-cd6458b337f1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:16.950842 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-322016d7-2023-4c73-8099-cd6458b337f1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:17.014370 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-322016d7-2023-4c73-8099-cd6458b337f1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Getting quotas for project a85ded3a20964dbbbc354199f5129d9b. Resources: {'cores', 'instances', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:41:17.027034 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-322016d7-2023-4c73-8099-cd6458b337f1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Getting quotas for user 9330e65e73394f18b87c5b1d5d47f564 and project a85ded3a20964dbbbc354199f5129d9b. Resources: {'cores', 'instances', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:41:17.049841 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-322016d7-2023-4c73-8099-cd6458b337f1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Going to run 1 instances... {{(pid=124266) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:41:17.072396 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-322016d7-2023-4c73-8099-cd6458b337f1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d74c4a51-21fe-41d5-865a-cb93604ac3aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:41:17.084684 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-01dbadbc-b50b-4f71-9199-f138baaf81ba tempest-VolumesTestJSON-1861020662 tempest-VolumesTestJSON-1861020662-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.189516 May 26 16:41:17.085541 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 27/53] 10.222.0.102 () {58 vars in 1159 bytes} [Thu May 26 16:41:16 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:17.091097 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-5c9b82fa-c9ef-4cc0-b3d3-fbefadb0dcfa tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] Calling method '.version_select at 0x7f93b0940280>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:17.247363 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-5c9b82fa-c9ef-4cc0-b3d3-fbefadb0dcfa tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/49d76927-e455-40b6-adbf-b9af63039985" status: 200 len: 345 microversion: 2.1 time: 0.158331 May 26 16:41:17.254299 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 28/54] 10.222.0.102 () {58 vars in 1249 bytes} [Thu May 26 16:41:17 2022] GET /compute/v2.1/os-volumes/49d76927-e455-40b6-adbf-b9af63039985 => generated 345 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:41:17.260923 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-40f63ffd-a518-4c7c-838c-4b36cbd57f55 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:17.261724 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-40f63ffd-a518-4c7c-838c-4b36cbd57f55 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:17.277185 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-40f63ffd-a518-4c7c-838c-4b36cbd57f55 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:17.279026 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-40f63ffd-a518-4c7c-838c-4b36cbd57f55 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:17.280023 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-40f63ffd-a518-4c7c-838c-4b36cbd57f55 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:17.280743 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-40f63ffd-a518-4c7c-838c-4b36cbd57f55 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:17.326838 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-322016d7-2023-4c73-8099-cd6458b337f1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 4.275100 May 26 16:41:17.334779 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 27/55] 10.222.0.102 () {60 vars in 1151 bytes} [Thu May 26 16:41:13 2022] POST /compute/v2.1/servers => generated 385 bytes in 4283 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) May 26 16:41:17.350255 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ff831bb2-055f-4cb3-906b-578319dd4328 tempest-VolumesTestJSON-1861020662 tempest-VolumesTestJSON-1861020662-project] Calling method '.version_select at 0x7f93b10ccdc0>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:17.544430 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ff831bb2-055f-4cb3-906b-578319dd4328 tempest-VolumesTestJSON-1861020662 tempest-VolumesTestJSON-1861020662-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.208360 May 26 16:41:17.545175 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 28/56] 10.222.0.102 () {58 vars in 1192 bytes} [Thu May 26 16:41:17 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:41:17.557516 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-862c0da8-6f12-415f-b6e0-c53bda77bd77 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-919936086", "imageRef": "d74c4a51-21fe-41d5-865a-cb93604ac3aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "56578ead-a93d-4f9e-9d57-95aac2ad89ae"}], "security_groups": [{"name": "tempest-securitygroup--1473612564"}], "key_name": "tempest-keypair-1583566214", "user_data": "}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:41:17.659500 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-40f63ffd-a518-4c7c-838c-4b36cbd57f55 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:17.667939 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-40f63ffd-a518-4c7c-838c-4b36cbd57f55 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1319 microversion: 2.1 time: 0.412155 May 26 16:41:17.669643 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 29/57] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:17 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1319 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:17.674532 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-3885ac86-612b-4e0b-a7d8-7b115441ec36 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:17.675230 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-3885ac86-612b-4e0b-a7d8-7b115441ec36 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:18.037367 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-3885ac86-612b-4e0b-a7d8-7b115441ec36 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:18.061736 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-3885ac86-612b-4e0b-a7d8-7b115441ec36 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1225 microversion: 2.1 time: 0.391112 May 26 16:41:18.066885 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.network.neutron [None req-862c0da8-6f12-415f-b6e0-c53bda77bd77 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] validate_networks() for [('56578ead-a93d-4f9e-9d57-95aac2ad89ae', None, None, None, None, None)] {{(pid=124266) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:41:18.067990 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 30/58] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:17 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1225 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:18.634094 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-27fbcf6f-af26-45f3-8174-a3d7d7dde43f tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Action: 'create', calling method: .version_select at 0x7f93b0940430>, body: {"keypair": {"name": "tempest-keypair-1131044428", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFi4cEdZq9KIMBT/QBTcY7WBRQl4zjhcrcsA5BiZGZyiHWp44/HHhoNUdLflOxpkRElbssusvkdA5q26js7XBcCYQs5mAous+sTNnfNZrs1QqaIvD6OKSORWD6Hjz1JSPg=="}} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:41:18.686418 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.quota [None req-27fbcf6f-af26-45f3-8174-a3d7d7dde43f tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Getting quotas for project 769867aa4086443a809d8fd8d3b605e2. Resources: {'key_pairs'} {{(pid=124267) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:41:18.697294 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.quota [None req-27fbcf6f-af26-45f3-8174-a3d7d7dde43f tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Getting quotas for user 2e5e1735e7f54f2d8943a0f55311394b and project 769867aa4086443a809d8fd8d3b605e2. Resources: {'key_pairs'} {{(pid=124267) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:41:18.839267 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-27fbcf6f-af26-45f3-8174-a3d7d7dde43f tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.749472 May 26 16:41:18.841219 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 31/59] 10.222.0.102 () {60 vars in 1163 bytes} [Thu May 26 16:41:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:41:18.861256 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-5c92858a-d249-49e7-92bf-acb0696d6a52 tempest-VolumesTestJSON-1861020662 tempest-VolumesTestJSON-1861020662-project] Calling method '.version_select at 0x7f93b08cc670>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:19.092914 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-5c92858a-d249-49e7-92bf-acb0696d6a52 tempest-VolumesTestJSON-1861020662 tempest-VolumesTestJSON-1861020662-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.249454 May 26 16:41:19.093848 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 32/60] 10.222.0.102 () {58 vars in 1159 bytes} [Thu May 26 16:41:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:19.101251 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-414a8b14-e1d3-4a5b-b0c4-ac63c324a044 tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] Calling method '.version_select at 0x7f93b08cc5e0>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:19.156996 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-862c0da8-6f12-415f-b6e0-c53bda77bd77 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Flavor limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:41:19.159014 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-862c0da8-6f12-415f-b6e0-c53bda77bd77 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Image limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:41:19.159637 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-862c0da8-6f12-415f-b6e0-c53bda77bd77 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Flavor pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:41:19.160481 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-862c0da8-6f12-415f-b6e0-c53bda77bd77 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Image pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:41:19.161078 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-862c0da8-6f12-415f-b6e0-c53bda77bd77 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:41:19.190924 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-862c0da8-6f12-415f-b6e0-c53bda77bd77 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:19.193765 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-862c0da8-6f12-415f-b6e0-c53bda77bd77 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:19.200399 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-862c0da8-6f12-415f-b6e0-c53bda77bd77 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:19.201892 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-862c0da8-6f12-415f-b6e0-c53bda77bd77 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:19.267267 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-414a8b14-e1d3-4a5b-b0c4-ac63c324a044 tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/49d76927-e455-40b6-adbf-b9af63039985" status: 200 len: 345 microversion: 2.1 time: 0.171033 May 26 16:41:19.268918 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 33/61] 10.222.0.102 () {58 vars in 1249 bytes} [Thu May 26 16:41:19 2022] GET /compute/v2.1/os-volumes/49d76927-e455-40b6-adbf-b9af63039985 => generated 345 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:41:19.286978 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-862c0da8-6f12-415f-b6e0-c53bda77bd77 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Getting quotas for project a69cba8eb64f4fcc87bbc6960a0abeb0. Resources: {'cores', 'instances', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:41:19.293052 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-f00210cb-99d0-43b7-adc5-be9d28ebfe33 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2083900566", "imageRef": "d74c4a51-21fe-41d5-865a-cb93604ac3aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:41:19.306008 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-862c0da8-6f12-415f-b6e0-c53bda77bd77 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Getting quotas for user e4941664ae624d4190ff53e5965db33f and project a69cba8eb64f4fcc87bbc6960a0abeb0. Resources: {'cores', 'instances', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:41:19.407800 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-862c0da8-6f12-415f-b6e0-c53bda77bd77 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Going to run 1 instances... {{(pid=124266) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:41:19.442418 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-862c0da8-6f12-415f-b6e0-c53bda77bd77 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d74c4a51-21fe-41d5-865a-cb93604ac3aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:41:19.524823 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.network.neutron [None req-f00210cb-99d0-43b7-adc5-be9d28ebfe33 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] validate_networks() for [('e8532e65-4cfe-4ff7-9b7e-e643c5e1e677', None, None, None, None, None)] {{(pid=124267) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:41:19.569334 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-862c0da8-6f12-415f-b6e0-c53bda77bd77 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.20 time: 2.017975 May 26 16:41:19.570247 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 29/62] 10.222.0.102 () {62 vars in 1192 bytes} [Thu May 26 16:41:17 2022] POST /compute/v2.1/servers => generated 404 bytes in 2020 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 26 16:41:19.576864 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f319051d-b059-47f2-b989-a36d0e4808fe tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:19.581779 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f319051d-b059-47f2-b989-a36d0e4808fe tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:19.591167 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f319051d-b059-47f2-b989-a36d0e4808fe tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:19.591979 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f319051d-b059-47f2-b989-a36d0e4808fe tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:19.597118 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f319051d-b059-47f2-b989-a36d0e4808fe tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:19.599986 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f319051d-b059-47f2-b989-a36d0e4808fe tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:20.249161 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f319051d-b059-47f2-b989-a36d0e4808fe tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:20.281509 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f319051d-b059-47f2-b989-a36d0e4808fe tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1319 microversion: 2.1 time: 0.708560 May 26 16:41:20.296618 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 30/63] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:19 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1319 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:20.310823 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f956a8f6-1658-4ab4-97c5-cb461f55fe35 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:20.314194 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f956a8f6-1658-4ab4-97c5-cb461f55fe35 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:20.803690 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f956a8f6-1658-4ab4-97c5-cb461f55fe35 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:20.812935 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f956a8f6-1658-4ab4-97c5-cb461f55fe35 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:20.820204 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f956a8f6-1658-4ab4-97c5-cb461f55fe35 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:20.823087 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f956a8f6-1658-4ab4-97c5-cb461f55fe35 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1285 microversion: 2.20 time: 0.523458 May 26 16:41:20.824496 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 31/64] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:41:20 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1285 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:41:20.833412 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e0983dd2-488b-4c37-aefd-7f064223d811 tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] Calling method '.version_select at 0x7f93b00aa310>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:21.058401 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e0983dd2-488b-4c37-aefd-7f064223d811 tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/49d76927-e455-40b6-adbf-b9af63039985" status: 200 len: 345 microversion: 2.1 time: 0.228550 May 26 16:41:21.059357 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 32/65] 10.222.0.102 () {58 vars in 1249 bytes} [Thu May 26 16:41:20 2022] GET /compute/v2.1/os-volumes/49d76927-e455-40b6-adbf-b9af63039985 => generated 345 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:41:21.300078 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-103bcd02-89bc-4967-bfc3-47e09ede6f9f tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:21.300804 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-103bcd02-89bc-4967-bfc3-47e09ede6f9f tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:21.312994 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-103bcd02-89bc-4967-bfc3-47e09ede6f9f tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:21.314219 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-103bcd02-89bc-4967-bfc3-47e09ede6f9f tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:21.320511 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-103bcd02-89bc-4967-bfc3-47e09ede6f9f tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:21.321305 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-103bcd02-89bc-4967-bfc3-47e09ede6f9f tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:23.431549 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-f00210cb-99d0-43b7-adc5-be9d28ebfe33 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Flavor limits 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:41:23.432119 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-f00210cb-99d0-43b7-adc5-be9d28ebfe33 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Image limits 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:41:23.432473 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-f00210cb-99d0-43b7-adc5-be9d28ebfe33 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Flavor pref 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:41:23.432895 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-f00210cb-99d0-43b7-adc5-be9d28ebfe33 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Image pref 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:41:23.433313 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-f00210cb-99d0-43b7-adc5-be9d28ebfe33 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:41:23.449153 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f00210cb-99d0-43b7-adc5-be9d28ebfe33 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:23.449625 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f00210cb-99d0-43b7-adc5-be9d28ebfe33 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:23.450454 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f00210cb-99d0-43b7-adc5-be9d28ebfe33 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:23.450897 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f00210cb-99d0-43b7-adc5-be9d28ebfe33 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:23.509950 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.quota [None req-f00210cb-99d0-43b7-adc5-be9d28ebfe33 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Getting quotas for project a85ded3a20964dbbbc354199f5129d9b. Resources: {'cores', 'instances', 'ram'} {{(pid=124267) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:41:23.517412 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.quota [None req-f00210cb-99d0-43b7-adc5-be9d28ebfe33 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Getting quotas for user 9330e65e73394f18b87c5b1d5d47f564 and project a85ded3a20964dbbbc354199f5129d9b. Resources: {'cores', 'instances', 'ram'} {{(pid=124267) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:41:23.541643 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-103bcd02-89bc-4967-bfc3-47e09ede6f9f tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:23.549069 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-f00210cb-99d0-43b7-adc5-be9d28ebfe33 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Going to run 1 instances... {{(pid=124267) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:41:23.554573 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-103bcd02-89bc-4967-bfc3-47e09ede6f9f tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1319 microversion: 2.1 time: 2.259162 May 26 16:41:23.554849 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-f00210cb-99d0-43b7-adc5-be9d28ebfe33 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d74c4a51-21fe-41d5-865a-cb93604ac3aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:41:23.556115 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 33/66] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:21 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1319 bytes in 2261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:23.572009 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d6443de5-b059-4642-9640-87da7f480248 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:23.572951 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d6443de5-b059-4642-9640-87da7f480248 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:23.579731 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d6443de5-b059-4642-9640-87da7f480248 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:23.580561 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d6443de5-b059-4642-9640-87da7f480248 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:23.581681 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d6443de5-b059-4642-9640-87da7f480248 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:23.582324 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d6443de5-b059-4642-9640-87da7f480248 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:23.648047 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-f00210cb-99d0-43b7-adc5-be9d28ebfe33 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 4.377208 May 26 16:41:23.649518 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 34/67] 10.222.0.102 () {60 vars in 1151 bytes} [Thu May 26 16:41:19 2022] POST /compute/v2.1/servers => generated 385 bytes in 4379 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 16:41:23.655327 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-4c40d263-a857-4c37-be6d-5f837668aec9 tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] Calling method '.version_select at 0x7f93b0940700>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:23.706080 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.wsgi [None req-4c40d263-a857-4c37-be6d-5f837668aec9 tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] HTTP exception thrown: Volume 49d76927-e455-40b6-adbf-b9af63039985 could not be found. May 26 16:41:23.710797 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-4c40d263-a857-4c37-be6d-5f837668aec9 tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] Request method failure captured: May 26 16:41:23.710797 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: request: GET /compute/v2.1/os-volumes/49d76927-e455-40b6-adbf-b9af63039985 HTTP/1.1 May 26 16:41:23.710797 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept: application/json May 26 16:41:23.710797 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept-Encoding: identity May 26 16:41:23.710797 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Connection: close May 26 16:41:23.710797 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Length: 0 May 26 16:41:23.710797 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Type: application/json May 26 16:41:23.710797 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Host: 10.222.0.102 May 26 16:41:23.710797 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Openstack-System-Scope: None May 26 16:41:23.710797 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: User-Agent: python-urllib3/1.26.9 May 26 16:41:23.710797 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Auth-Token: gAAAAABij62bygB317E0QeHfFFgE0wJV3BhkH9sL13Xt7DASnCGIZWoowT2MEGkHiDJjWB3j_XwDyIeNb706600C-ChBo0XSrJ5e8Brh1PQyM_4EIlLh4v0IyCio3gk0TpyjicYJnfZzPftQlmlXGlt5wP_VtqKs8jQohnntz0Gl8JGLZ-FLywM May 26 16:41:23.710797 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Id: None May 26 16:41:23.710797 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Name: None May 26 16:41:23.710797 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Identity-Status: Confirmed May 26 16:41:23.710797 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Is-Admin-Project: True May 26 16:41:23.710797 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Id: default May 26 16:41:23.710797 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Name: Default May 26 16:41:23.710797 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Id: f7449f3a96c8444a8efdb118290cc4e0 May 26 16:41:23.710797 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-143745927 May 26 16:41:23.710797 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Role: reader,member May 26 16:41:23.710797 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Roles: reader,member May 26 16:41:23.712176 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/f7449f3a96c8444a8efdb118290cc4e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/f7449f3a96c8444a8efdb118290cc4e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/f7449f3a96c8444a8efdb118290cc4e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_f7449f3a96c8444a8efdb118290cc4e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:41:23.712176 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant: tempest-VolumesSnapshotsTestJSON-143745927 May 26 16:41:23.712176 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Id: f7449f3a96c8444a8efdb118290cc4e0 May 26 16:41:23.712176 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-143745927 May 26 16:41:23.712176 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User: tempest-VolumesSnapshotsTestJSON-143745927-project May 26 16:41:23.712176 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Id: default May 26 16:41:23.712176 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Name: Default May 26 16:41:23.712176 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Id: 602566fb23bc463c834d92cdc035fbd7 May 26 16:41:23.712176 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Name: tempest-VolumesSnapshotsTestJSON-143745927-project May 26 16:41:23.712176 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: method: May 26 16:41:23.712176 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: exception: Volume 49d76927-e455-40b6-adbf-b9af63039985 could not be found. May 26 16:41:23.712176 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: action_args: {'id': '49d76927-e455-40b6-adbf-b9af63039985'} May 26 16:41:23.712176 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:41:23.712858 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:23.712858 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 16:41:23.712858 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 16:41:23.712858 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 16:41:23.712858 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 16:41:23.712858 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 16:41:23.712858 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 16:41:23.712858 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 16:41:23.712858 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 16:41:23.712858 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 16:41:23.712858 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 16:41:23.712858 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 16:41:23.712858 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 16:41:23.712858 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 16:41:23.712858 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 16:41:23.712858 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 49d76927-e455-40b6-adbf-b9af63039985 could not be found. (HTTP 404) (Request-ID: req-8f952772-2b2c-42e5-9a58-8d15a486378b) May 26 16:41:23.712858 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:41:23.712858 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:41:23.712858 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:41:23.713737 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:23.713737 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 16:41:23.713737 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 16:41:23.713737 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 16:41:23.713737 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 16:41:23.713737 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 16:41:23.713737 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 16:41:23.713737 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 16:41:23.713737 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 16:41:23.713737 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 16:41:23.713737 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 16:41:23.713737 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 16:41:23.713737 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 16:41:23.713737 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 16:41:23.713737 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 16:41:23.713737 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 16:41:23.713737 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 16:41:23.713737 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 16:41:23.713737 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 16:41:23.714735 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 16:41:23.714735 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 16:41:23.714735 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 16:41:23.714735 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 16:41:23.714735 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 49d76927-e455-40b6-adbf-b9af63039985 could not be found. May 26 16:41:23.714735 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:41:23.714735 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:41:23.714735 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:41:23.714735 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:23.714735 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:41:23.714735 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:41:23.714735 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:41:23.714735 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:41:23.714735 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 16:41:23.714735 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 16:41:23.714735 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:41:23.714735 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:41:23.714735 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 16:41:23.714735 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:41:23.715759 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 49d76927-e455-40b6-adbf-b9af63039985 could not be found. May 26 16:41:23.715759 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:41:23.715759 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:41:23.715759 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:41:23.715759 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:23.715759 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:41:23.715759 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:41:23.715759 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:41:23.715759 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:41:23.715759 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 49d76927-e455-40b6-adbf-b9af63039985 could not be found. May 26 16:41:23.715759 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:41:23.715759 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-4c40d263-a857-4c37-be6d-5f837668aec9 tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] Returning 404 to user: Volume 49d76927-e455-40b6-adbf-b9af63039985 could not be found. {{(pid=124267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:41:23.715759 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-4c40d263-a857-4c37-be6d-5f837668aec9 tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/49d76927-e455-40b6-adbf-b9af63039985" status: 404 len: 109 microversion: 2.1 time: 0.062506 May 26 16:41:23.727242 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 35/68] 10.222.0.102 () {58 vars in 1249 bytes} [Thu May 26 16:41:23 2022] GET /compute/v2.1/os-volumes/49d76927-e455-40b6-adbf-b9af63039985 => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 16:41:23.743058 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-cf03bfdf-77ab-45f6-820f-88ca9b0bb1d5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:23.747587 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-cf03bfdf-77ab-45f6-820f-88ca9b0bb1d5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:23.769443 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d6443de5-b059-4642-9640-87da7f480248 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:23.793661 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d6443de5-b059-4642-9640-87da7f480248 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:23.796117 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d6443de5-b059-4642-9640-87da7f480248 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:23.801718 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d6443de5-b059-4642-9640-87da7f480248 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1337 microversion: 2.20 time: 0.234359 May 26 16:41:23.802641 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 34/69] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:41:23 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1337 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:41:23.809050 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-37afdf50-b353-4146-948c-e1ba8e02191f tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] Calling method '.version_select at 0x7f93b00b7af0>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:23.895313 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-37afdf50-b353-4146-948c-e1ba8e02191f tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] HTTP exception thrown: Volume 49d76927-e455-40b6-adbf-b9af63039985 could not be found. May 26 16:41:23.897598 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-37afdf50-b353-4146-948c-e1ba8e02191f tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] Request method failure captured: May 26 16:41:23.897598 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: request: DELETE /compute/v2.1/os-volumes/49d76927-e455-40b6-adbf-b9af63039985 HTTP/1.1 May 26 16:41:23.897598 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept: application/json May 26 16:41:23.897598 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity May 26 16:41:23.897598 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Connection: close May 26 16:41:23.897598 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Length: 0 May 26 16:41:23.897598 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Type: application/json May 26 16:41:23.897598 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Host: 10.222.0.102 May 26 16:41:23.897598 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None May 26 16:41:23.897598 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 May 26 16:41:23.897598 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABij62bygB317E0QeHfFFgE0wJV3BhkH9sL13Xt7DASnCGIZWoowT2MEGkHiDJjWB3j_XwDyIeNb706600C-ChBo0XSrJ5e8Brh1PQyM_4EIlLh4v0IyCio3gk0TpyjicYJnfZzPftQlmlXGlt5wP_VtqKs8jQohnntz0Gl8JGLZ-FLywM May 26 16:41:23.897598 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Id: None May 26 16:41:23.897598 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Name: None May 26 16:41:23.897598 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed May 26 16:41:23.897598 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True May 26 16:41:23.897598 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default May 26 16:41:23.897598 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default May 26 16:41:23.897598 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Id: f7449f3a96c8444a8efdb118290cc4e0 May 26 16:41:23.897598 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-143745927 May 26 16:41:23.897598 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Role: reader,member May 26 16:41:23.897598 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Roles: reader,member May 26 16:41:23.898762 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/f7449f3a96c8444a8efdb118290cc4e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/f7449f3a96c8444a8efdb118290cc4e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/f7449f3a96c8444a8efdb118290cc4e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_f7449f3a96c8444a8efdb118290cc4e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:41:23.898762 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-VolumesSnapshotsTestJSON-143745927 May 26 16:41:23.898762 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Id: f7449f3a96c8444a8efdb118290cc4e0 May 26 16:41:23.898762 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-143745927 May 26 16:41:23.898762 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User: tempest-VolumesSnapshotsTestJSON-143745927-project May 26 16:41:23.898762 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default May 26 16:41:23.898762 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default May 26 16:41:23.898762 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Id: 602566fb23bc463c834d92cdc035fbd7 May 26 16:41:23.898762 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-VolumesSnapshotsTestJSON-143745927-project May 26 16:41:23.898762 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: method: May 26 16:41:23.898762 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: exception: Volume 49d76927-e455-40b6-adbf-b9af63039985 could not be found. May 26 16:41:23.898762 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: action_args: {'id': '49d76927-e455-40b6-adbf-b9af63039985'} May 26 16:41:23.898762 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:41:23.899407 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:23.899407 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 16:41:23.899407 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 16:41:23.899407 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 16:41:23.899407 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 16:41:23.899407 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 16:41:23.899407 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 16:41:23.899407 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 16:41:23.899407 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 16:41:23.899407 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 16:41:23.899407 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 16:41:23.899407 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 16:41:23.899407 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 16:41:23.899407 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 16:41:23.899407 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 16:41:23.899407 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 49d76927-e455-40b6-adbf-b9af63039985 could not be found. (HTTP 404) (Request-ID: req-1cca2e2f-2083-42c0-bc79-2b56a36e815b) May 26 16:41:23.899407 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:23.899407 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:41:23.899407 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:23.900332 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:23.900332 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 16:41:23.900332 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 16:41:23.900332 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 16:41:23.900332 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 16:41:23.900332 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 16:41:23.900332 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 16:41:23.900332 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 16:41:23.900332 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 16:41:23.900332 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 16:41:23.900332 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 16:41:23.900332 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 16:41:23.900332 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 16:41:23.900332 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 16:41:23.900332 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 16:41:23.900332 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 16:41:23.900332 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 16:41:23.900332 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 16:41:23.900332 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 16:41:23.901459 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 16:41:23.901459 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 16:41:23.901459 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 16:41:23.901459 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 16:41:23.901459 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 49d76927-e455-40b6-adbf-b9af63039985 could not be found. May 26 16:41:23.901459 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:23.901459 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:41:23.901459 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:23.901459 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:23.901459 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:41:23.901459 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:41:23.901459 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:41:23.901459 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:41:23.901459 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 16:41:23.901459 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 16:41:23.901459 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:41:23.901459 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:41:23.901459 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 16:41:23.901459 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:41:23.902408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 49d76927-e455-40b6-adbf-b9af63039985 could not be found. May 26 16:41:23.902408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:23.902408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:41:23.902408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:23.902408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:23.902408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:41:23.902408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:41:23.902408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:41:23.902408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:41:23.902408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 49d76927-e455-40b6-adbf-b9af63039985 could not be found. May 26 16:41:23.902408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:23.902408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-37afdf50-b353-4146-948c-e1ba8e02191f tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] Returning 404 to user: Volume 49d76927-e455-40b6-adbf-b9af63039985 could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:41:23.902408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-37afdf50-b353-4146-948c-e1ba8e02191f tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] 10.222.0.102 "DELETE /compute/v2.1/os-volumes/49d76927-e455-40b6-adbf-b9af63039985" status: 404 len: 109 microversion: 2.1 time: 0.094817 May 26 16:41:23.902408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 35/70] 10.222.0.102 () {58 vars in 1252 bytes} [Thu May 26 16:41:23 2022] DELETE /compute/v2.1/os-volumes/49d76927-e455-40b6-adbf-b9af63039985 => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 16:41:23.911757 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-4106e17d-cd3b-43b5-98fb-3dce1bc7558d tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] Calling method '.version_select at 0x7f93b00aaca0>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:24.021552 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-4106e17d-cd3b-43b5-98fb-3dce1bc7558d tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] HTTP exception thrown: Volume 49d76927-e455-40b6-adbf-b9af63039985 could not be found. May 26 16:41:24.023474 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-4106e17d-cd3b-43b5-98fb-3dce1bc7558d tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] Request method failure captured: May 26 16:41:24.023474 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/os-volumes/49d76927-e455-40b6-adbf-b9af63039985 HTTP/1.1 May 26 16:41:24.023474 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept: application/json May 26 16:41:24.023474 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity May 26 16:41:24.023474 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Connection: close May 26 16:41:24.023474 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Length: 0 May 26 16:41:24.023474 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Type: application/json May 26 16:41:24.023474 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Host: 10.222.0.102 May 26 16:41:24.023474 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None May 26 16:41:24.023474 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 May 26 16:41:24.023474 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABij62bygB317E0QeHfFFgE0wJV3BhkH9sL13Xt7DASnCGIZWoowT2MEGkHiDJjWB3j_XwDyIeNb706600C-ChBo0XSrJ5e8Brh1PQyM_4EIlLh4v0IyCio3gk0TpyjicYJnfZzPftQlmlXGlt5wP_VtqKs8jQohnntz0Gl8JGLZ-FLywM May 26 16:41:24.023474 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Id: None May 26 16:41:24.023474 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Name: None May 26 16:41:24.023474 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed May 26 16:41:24.023474 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True May 26 16:41:24.023474 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default May 26 16:41:24.023474 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default May 26 16:41:24.023474 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Id: f7449f3a96c8444a8efdb118290cc4e0 May 26 16:41:24.023474 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-143745927 May 26 16:41:24.023474 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Role: reader,member May 26 16:41:24.023474 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Roles: reader,member May 26 16:41:24.024844 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/f7449f3a96c8444a8efdb118290cc4e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/f7449f3a96c8444a8efdb118290cc4e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/f7449f3a96c8444a8efdb118290cc4e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_f7449f3a96c8444a8efdb118290cc4e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:41:24.024844 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-VolumesSnapshotsTestJSON-143745927 May 26 16:41:24.024844 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Id: f7449f3a96c8444a8efdb118290cc4e0 May 26 16:41:24.024844 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-143745927 May 26 16:41:24.024844 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User: tempest-VolumesSnapshotsTestJSON-143745927-project May 26 16:41:24.024844 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default May 26 16:41:24.024844 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default May 26 16:41:24.024844 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Id: 602566fb23bc463c834d92cdc035fbd7 May 26 16:41:24.024844 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-VolumesSnapshotsTestJSON-143745927-project May 26 16:41:24.024844 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: method: May 26 16:41:24.024844 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: exception: Volume 49d76927-e455-40b6-adbf-b9af63039985 could not be found. May 26 16:41:24.024844 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: action_args: {'id': '49d76927-e455-40b6-adbf-b9af63039985'} May 26 16:41:24.024844 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:41:24.025468 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:24.025468 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 16:41:24.025468 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 16:41:24.025468 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 16:41:24.025468 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 16:41:24.025468 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 16:41:24.025468 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 16:41:24.025468 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 16:41:24.025468 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 16:41:24.025468 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 16:41:24.025468 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 16:41:24.025468 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 16:41:24.025468 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 16:41:24.025468 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 16:41:24.025468 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 16:41:24.025468 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 49d76927-e455-40b6-adbf-b9af63039985 could not be found. (HTTP 404) (Request-ID: req-b8b1b1e2-01fe-427d-80ae-540864b6329a) May 26 16:41:24.025468 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:24.025468 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:41:24.025468 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:24.026366 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:24.026366 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 16:41:24.026366 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 16:41:24.026366 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 16:41:24.026366 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 16:41:24.026366 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 16:41:24.026366 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 16:41:24.026366 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 16:41:24.026366 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 16:41:24.026366 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 16:41:24.026366 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 16:41:24.026366 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 16:41:24.026366 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 16:41:24.026366 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 16:41:24.026366 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 16:41:24.026366 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 16:41:24.026366 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 16:41:24.026366 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 16:41:24.026366 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 16:41:24.027473 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 16:41:24.027473 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 16:41:24.027473 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 16:41:24.027473 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 16:41:24.027473 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 49d76927-e455-40b6-adbf-b9af63039985 could not be found. May 26 16:41:24.027473 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:24.027473 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:41:24.027473 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:24.027473 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:24.027473 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:41:24.027473 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:41:24.027473 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:41:24.027473 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:41:24.027473 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 16:41:24.027473 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 16:41:24.027473 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:41:24.027473 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:41:24.027473 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 16:41:24.027473 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:41:24.028530 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 49d76927-e455-40b6-adbf-b9af63039985 could not be found. May 26 16:41:24.028530 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:24.028530 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:41:24.028530 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:24.028530 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:41:24.028530 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:41:24.028530 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:41:24.028530 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:41:24.028530 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:41:24.028530 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 49d76927-e455-40b6-adbf-b9af63039985 could not be found. May 26 16:41:24.028530 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:41:24.031718 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-4106e17d-cd3b-43b5-98fb-3dce1bc7558d tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] Returning 404 to user: Volume 49d76927-e455-40b6-adbf-b9af63039985 could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:41:24.032956 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-4106e17d-cd3b-43b5-98fb-3dce1bc7558d tempest-VolumesSnapshotsTestJSON-143745927 tempest-VolumesSnapshotsTestJSON-143745927-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/49d76927-e455-40b6-adbf-b9af63039985" status: 404 len: 109 microversion: 2.1 time: 0.125128 May 26 16:41:24.034283 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 36/71] 10.222.0.102 () {58 vars in 1249 bytes} [Thu May 26 16:41:23 2022] GET /compute/v2.1/os-volumes/49d76927-e455-40b6-adbf-b9af63039985 => generated 109 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 16:41:24.052326 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-cf03bfdf-77ab-45f6-820f-88ca9b0bb1d5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:24.061085 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-cf03bfdf-77ab-45f6-820f-88ca9b0bb1d5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1226 microversion: 2.1 time: 0.330111 May 26 16:41:24.067541 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 36/72] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:23 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1226 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:24.574008 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0359f6fb-4fe9-4faa-83e6-a792d3648718 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:24.574638 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0359f6fb-4fe9-4faa-83e6-a792d3648718 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:24.585232 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0359f6fb-4fe9-4faa-83e6-a792d3648718 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:24.596520 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0359f6fb-4fe9-4faa-83e6-a792d3648718 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:24.610045 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0359f6fb-4fe9-4faa-83e6-a792d3648718 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:24.610521 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0359f6fb-4fe9-4faa-83e6-a792d3648718 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:24.826009 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-4e77b72e-b82d-42ce-a2dd-79816ffac398 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:24.826661 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-4e77b72e-b82d-42ce-a2dd-79816ffac398 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:24.846438 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4e77b72e-b82d-42ce-a2dd-79816ffac398 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:24.852539 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4e77b72e-b82d-42ce-a2dd-79816ffac398 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:24.863508 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4e77b72e-b82d-42ce-a2dd-79816ffac398 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:24.865277 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4e77b72e-b82d-42ce-a2dd-79816ffac398 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:25.531468 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-4e77b72e-b82d-42ce-a2dd-79816ffac398 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:25.532241 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0359f6fb-4fe9-4faa-83e6-a792d3648718 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:25.548173 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-4e77b72e-b82d-42ce-a2dd-79816ffac398 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:25.549800 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-4e77b72e-b82d-42ce-a2dd-79816ffac398 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:25.552418 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0359f6fb-4fe9-4faa-83e6-a792d3648718 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1319 microversion: 2.1 time: 0.982841 May 26 16:41:25.560266 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 37/73] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:24 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1319 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:25.565920 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-4e77b72e-b82d-42ce-a2dd-79816ffac398 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1345 microversion: 2.20 time: 0.743651 May 26 16:41:25.570288 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-461e7082-27e1-4ea6-9f1e-81e0c99019b8 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:25.571465 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-461e7082-27e1-4ea6-9f1e-81e0c99019b8 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:25.585432 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 37/74] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:41:24 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1345 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:41:25.607982 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-461e7082-27e1-4ea6-9f1e-81e0c99019b8 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:25.609781 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-461e7082-27e1-4ea6-9f1e-81e0c99019b8 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:25.614196 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-461e7082-27e1-4ea6-9f1e-81e0c99019b8 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:25.614661 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-461e7082-27e1-4ea6-9f1e-81e0c99019b8 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:25.812233 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-7d670dd1-7a75-420b-aac7-ec39081d7f80 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-220733822", "imageRef": "d74c4a51-21fe-41d5-865a-cb93604ac3aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "df66d935-a4b3-44d2-8e7d-0763779d3216"}], "security_groups": [{"name": "tempest-securitygroup--657401250"}], "key_name": "tempest-keypair-1131044428", "user_data": "}} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:41:26.651839 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-461e7082-27e1-4ea6-9f1e-81e0c99019b8 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:26.663098 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-461e7082-27e1-4ea6-9f1e-81e0c99019b8 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1222 microversion: 2.1 time: 1.100011 May 26 16:41:26.663910 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 38/75] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:25 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1222 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:26.677807 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ad879a5e-8b7b-4c70-a00a-af413f6398d2 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:26.678671 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ad879a5e-8b7b-4c70-a00a-af413f6398d2 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:26.693357 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ad879a5e-8b7b-4c70-a00a-af413f6398d2 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:26.696580 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ad879a5e-8b7b-4c70-a00a-af413f6398d2 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:26.697924 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ad879a5e-8b7b-4c70-a00a-af413f6398d2 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:26.704761 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ad879a5e-8b7b-4c70-a00a-af413f6398d2 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:26.851136 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.network.neutron [None req-7d670dd1-7a75-420b-aac7-ec39081d7f80 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] validate_networks() for [('df66d935-a4b3-44d2-8e7d-0763779d3216', None, None, None, None, None)] {{(pid=124267) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:41:28.378748 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ad879a5e-8b7b-4c70-a00a-af413f6398d2 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:28.392072 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ad879a5e-8b7b-4c70-a00a-af413f6398d2 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1319 microversion: 2.1 time: 1.718301 May 26 16:41:28.400885 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 39/76] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:26 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1319 bytes in 1728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:28.422195 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f607600e-f9ee-460e-a182-b435d5dc3970 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:28.424186 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f607600e-f9ee-460e-a182-b435d5dc3970 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:28.449112 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f607600e-f9ee-460e-a182-b435d5dc3970 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:28.452275 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f607600e-f9ee-460e-a182-b435d5dc3970 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:28.453351 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f607600e-f9ee-460e-a182-b435d5dc3970 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:28.453968 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f607600e-f9ee-460e-a182-b435d5dc3970 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:28.720206 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f607600e-f9ee-460e-a182-b435d5dc3970 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:28.743314 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f607600e-f9ee-460e-a182-b435d5dc3970 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:28.754610 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f607600e-f9ee-460e-a182-b435d5dc3970 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:28.763923 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f607600e-f9ee-460e-a182-b435d5dc3970 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1343 microversion: 2.20 time: 0.357360 May 26 16:41:28.765132 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 40/77] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:41:28 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1343 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:41:28.794979 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3ee86c70-5654-4cce-b2df-4f76921ccdc0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:28.823965 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-3ee86c70-5654-4cce-b2df-4f76921ccdc0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:28.877281 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3ee86c70-5654-4cce-b2df-4f76921ccdc0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:28.877762 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3ee86c70-5654-4cce-b2df-4f76921ccdc0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:28.884796 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3ee86c70-5654-4cce-b2df-4f76921ccdc0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:28.885413 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3ee86c70-5654-4cce-b2df-4f76921ccdc0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:29.115332 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3ee86c70-5654-4cce-b2df-4f76921ccdc0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:29.137785 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-3ee86c70-5654-4cce-b2df-4f76921ccdc0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1284 microversion: 2.1 time: 0.367683 May 26 16:41:29.143367 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 41/78] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:28 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1284 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:29.413624 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-01883e16-62f7-472f-9d05-28a2bdff436b tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:29.414284 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-01883e16-62f7-472f-9d05-28a2bdff436b tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:29.416831 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=4 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:29.437716 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-01883e16-62f7-472f-9d05-28a2bdff436b tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:29.438743 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-01883e16-62f7-472f-9d05-28a2bdff436b tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:29.440205 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-01883e16-62f7-472f-9d05-28a2bdff436b tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:29.443725 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-01883e16-62f7-472f-9d05-28a2bdff436b tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:30.808605 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=20 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:30.972967 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-01883e16-62f7-472f-9d05-28a2bdff436b tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:30.979281 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=69 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:30.985164 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-01883e16-62f7-472f-9d05-28a2bdff436b tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1319 microversion: 2.1 time: 1.578850 May 26 16:41:30.996585 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 42/79] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:29 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1319 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:31.017814 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-902eca45-6eb4-4145-8cf9-5fd870d5cbde tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:31.021187 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-902eca45-6eb4-4145-8cf9-5fd870d5cbde tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:31.039627 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=7 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:31.043598 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-902eca45-6eb4-4145-8cf9-5fd870d5cbde tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:31.045005 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-902eca45-6eb4-4145-8cf9-5fd870d5cbde tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:31.046080 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-902eca45-6eb4-4145-8cf9-5fd870d5cbde tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:31.049053 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-902eca45-6eb4-4145-8cf9-5fd870d5cbde tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:31.129426 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-7d670dd1-7a75-420b-aac7-ec39081d7f80 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Flavor limits 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:41:31.130463 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-7d670dd1-7a75-420b-aac7-ec39081d7f80 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Image limits 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:41:31.131113 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-7d670dd1-7a75-420b-aac7-ec39081d7f80 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Flavor pref 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:41:31.131529 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-7d670dd1-7a75-420b-aac7-ec39081d7f80 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Image pref 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:41:31.131950 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-7d670dd1-7a75-420b-aac7-ec39081d7f80 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:41:31.136846 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=7 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:31.159778 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7d670dd1-7a75-420b-aac7-ec39081d7f80 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:31.160244 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7d670dd1-7a75-420b-aac7-ec39081d7f80 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:31.161087 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7d670dd1-7a75-420b-aac7-ec39081d7f80 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:31.161538 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7d670dd1-7a75-420b-aac7-ec39081d7f80 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:31.181611 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=41 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:31.203988 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.quota [None req-7d670dd1-7a75-420b-aac7-ec39081d7f80 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Getting quotas for project 769867aa4086443a809d8fd8d3b605e2. Resources: {'cores', 'instances', 'ram'} {{(pid=124267) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:41:31.214763 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.quota [None req-7d670dd1-7a75-420b-aac7-ec39081d7f80 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Getting quotas for user 2e5e1735e7f54f2d8943a0f55311394b and project 769867aa4086443a809d8fd8d3b605e2. Resources: {'cores', 'instances', 'ram'} {{(pid=124267) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:41:31.248584 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-7d670dd1-7a75-420b-aac7-ec39081d7f80 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Going to run 1 instances... {{(pid=124267) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:41:31.250954 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-7d670dd1-7a75-420b-aac7-ec39081d7f80 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d74c4a51-21fe-41d5-865a-cb93604ac3aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:41:31.350314 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-902eca45-6eb4-4145-8cf9-5fd870d5cbde tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:31.362779 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-7d670dd1-7a75-420b-aac7-ec39081d7f80 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 5.556437 May 26 16:41:31.369432 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 38/80] 10.222.0.102 () {60 vars in 1151 bytes} [Thu May 26 16:41:25 2022] POST /compute/v2.1/servers => generated 403 bytes in 5564 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 16:41:31.372495 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-902eca45-6eb4-4145-8cf9-5fd870d5cbde tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:31.374836 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-902eca45-6eb4-4145-8cf9-5fd870d5cbde tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:31.376249 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-902eca45-6eb4-4145-8cf9-5fd870d5cbde tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1343 microversion: 2.20 time: 0.376293 May 26 16:41:31.383695 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-c18ea8f9-c0bc-4f2e-916d-ac18afa2505f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:31.386991 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 43/81] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:41:30 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1343 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:41:31.387737 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-c18ea8f9-c0bc-4f2e-916d-ac18afa2505f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:31.412027 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c18ea8f9-c0bc-4f2e-916d-ac18afa2505f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:31.412524 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c18ea8f9-c0bc-4f2e-916d-ac18afa2505f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:31.413349 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c18ea8f9-c0bc-4f2e-916d-ac18afa2505f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:31.417097 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c18ea8f9-c0bc-4f2e-916d-ac18afa2505f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:31.586091 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-c18ea8f9-c0bc-4f2e-916d-ac18afa2505f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:31.601492 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-c18ea8f9-c0bc-4f2e-916d-ac18afa2505f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1284 microversion: 2.1 time: 0.227697 May 26 16:41:31.606140 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 39/82] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:31 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1284 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:31.615344 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-0382fff0-8efb-4479-8ebc-0ec171ad605a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:31.618993 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-0382fff0-8efb-4479-8ebc-0ec171ad605a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:31.730182 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-e662e830-a0a8-4e6e-b5a1-122090f20f8f req-510fbbe5-7513-4250-9794-e0bd7665fa3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a691d98-aaca-4c24-9200-19517540e68e", "tag": "410fa846-df15-41e9-907f-35655843eded"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:41:31.770128 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-e662e830-a0a8-4e6e-b5a1-122090f20f8f req-510fbbe5-7513-4250-9794-e0bd7665fa3f service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:31.770881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-e662e830-a0a8-4e6e-b5a1-122090f20f8f req-510fbbe5-7513-4250-9794-e0bd7665fa3f service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:31.801181 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-e662e830-a0a8-4e6e-b5a1-122090f20f8f req-510fbbe5-7513-4250-9794-e0bd7665fa3f service nova] Creating event network-changed:410fa846-df15-41e9-907f-35655843eded for instance 6a691d98-aaca-4c24-9200-19517540e68e on hv-cinder-83607 May 26 16:41:31.802678 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-e662e830-a0a8-4e6e-b5a1-122090f20f8f req-510fbbe5-7513-4250-9794-e0bd7665fa3f service nova] Acquired lock "compute-rpcapi-router" {{(pid=124266) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 26 16:41:31.805260 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dc93422b-99dc-46f9-8221-987fa89806f0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:31.806043 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dc93422b-99dc-46f9-8221-987fa89806f0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:31.807303 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dc93422b-99dc-46f9-8221-987fa89806f0 None None] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:31.808178 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dc93422b-99dc-46f9-8221-987fa89806f0 None None] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:31.821042 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-0382fff0-8efb-4479-8ebc-0ec171ad605a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:31.827738 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.compute.rpcapi [None req-dc93422b-99dc-46f9-8221-987fa89806f0 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 26 16:41:31.830329 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dc93422b-99dc-46f9-8221-987fa89806f0 None None] Releasing lock "compute-rpcapi-router" {{(pid=124266) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 26 16:41:31.832667 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-0382fff0-8efb-4479-8ebc-0ec171ad605a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1241 microversion: 2.1 time: 0.222490 May 26 16:41:31.833614 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 40/83] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:31 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1241 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:31.873783 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-dc93422b-99dc-46f9-8221-987fa89806f0 None None] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.485044 May 26 16:41:31.875039 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 44/84] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:41:32.008162 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-578a5e17-132e-4a39-ae13-8ae4673a2fb0 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:32.008782 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-578a5e17-132e-4a39-ae13-8ae4673a2fb0 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:32.034961 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-578a5e17-132e-4a39-ae13-8ae4673a2fb0 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:32.035422 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-578a5e17-132e-4a39-ae13-8ae4673a2fb0 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:32.036319 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-578a5e17-132e-4a39-ae13-8ae4673a2fb0 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:32.036796 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-578a5e17-132e-4a39-ae13-8ae4673a2fb0 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:32.207499 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-13c3becb-5599-4571-8982-5bbcbeffb4e1 req-108b42f8-9792-4269-b101-0e789556fcaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bcd849c-2f03-44d0-9c4b-350431056dea", "tag": "05f50936-b66b-4d09-b68b-ab827d36742f"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:41:32.245738 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-13c3becb-5599-4571-8982-5bbcbeffb4e1 req-108b42f8-9792-4269-b101-0e789556fcaa service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:32.248600 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-13c3becb-5599-4571-8982-5bbcbeffb4e1 req-108b42f8-9792-4269-b101-0e789556fcaa service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:32.334593 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-13c3becb-5599-4571-8982-5bbcbeffb4e1 req-108b42f8-9792-4269-b101-0e789556fcaa service nova] Creating event network-changed:05f50936-b66b-4d09-b68b-ab827d36742f for instance 6bcd849c-2f03-44d0-9c4b-350431056dea on hv-cinder-83607 May 26 16:41:32.337507 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-13c3becb-5599-4571-8982-5bbcbeffb4e1 req-108b42f8-9792-4269-b101-0e789556fcaa service nova] Acquired lock "compute-rpcapi-router" {{(pid=124267) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 26 16:41:32.338945 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-26e9a8dc-21a0-4c2b-8683-cd045b36d302 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:32.344725 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-26e9a8dc-21a0-4c2b-8683-cd045b36d302 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:32.346131 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-26e9a8dc-21a0-4c2b-8683-cd045b36d302 None None] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:32.346739 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-26e9a8dc-21a0-4c2b-8683-cd045b36d302 None None] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:32.370350 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.compute.rpcapi [None req-26e9a8dc-21a0-4c2b-8683-cd045b36d302 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 26 16:41:32.371287 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-26e9a8dc-21a0-4c2b-8683-cd045b36d302 None None] Releasing lock "compute-rpcapi-router" {{(pid=124267) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 26 16:41:32.407648 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-26e9a8dc-21a0-4c2b-8683-cd045b36d302 None None] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.561972 May 26 16:41:32.410012 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 41/85] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:41:32.428698 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-0a844b13-786a-46ee-9297-af273a01e4ed tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:32.431856 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-0a844b13-786a-46ee-9297-af273a01e4ed tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:32.443204 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0a844b13-786a-46ee-9297-af273a01e4ed tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:32.443899 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0a844b13-786a-46ee-9297-af273a01e4ed tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:32.467291 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0a844b13-786a-46ee-9297-af273a01e4ed tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:32.468573 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0a844b13-786a-46ee-9297-af273a01e4ed tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:33.184979 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-578a5e17-132e-4a39-ae13-8ae4673a2fb0 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:33.196399 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-578a5e17-132e-4a39-ae13-8ae4673a2fb0 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1319 microversion: 2.1 time: 1.196464 May 26 16:41:33.197373 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 45/86] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:31 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1319 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:33.203482 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-be667ab6-12d0-4034-a8d1-f4657dca59d2 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:33.204743 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-be667ab6-12d0-4034-a8d1-f4657dca59d2 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:33.229602 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-be667ab6-12d0-4034-a8d1-f4657dca59d2 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:33.230447 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-be667ab6-12d0-4034-a8d1-f4657dca59d2 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:33.231502 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-be667ab6-12d0-4034-a8d1-f4657dca59d2 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:33.232216 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-be667ab6-12d0-4034-a8d1-f4657dca59d2 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:33.406106 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-0a844b13-786a-46ee-9297-af273a01e4ed tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:33.417746 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-0a844b13-786a-46ee-9297-af273a01e4ed tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:33.417746 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-0a844b13-786a-46ee-9297-af273a01e4ed tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:33.424879 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-0a844b13-786a-46ee-9297-af273a01e4ed tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1411 microversion: 2.20 time: 1.012333 May 26 16:41:33.425992 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 42/87] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:41:32 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1411 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:41:33.449036 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-68d70858-6a54-4150-9ecd-47e0408f4315 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:33.449958 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-68d70858-6a54-4150-9ecd-47e0408f4315 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:33.459209 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-68d70858-6a54-4150-9ecd-47e0408f4315 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:33.459975 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-68d70858-6a54-4150-9ecd-47e0408f4315 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:33.461241 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-68d70858-6a54-4150-9ecd-47e0408f4315 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:33.462481 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-68d70858-6a54-4150-9ecd-47e0408f4315 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:33.997933 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-68d70858-6a54-4150-9ecd-47e0408f4315 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:34.012828 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-68d70858-6a54-4150-9ecd-47e0408f4315 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1293 microversion: 2.1 time: 0.570024 May 26 16:41:34.026624 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 43/88] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:33 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1293 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:34.117283 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-be667ab6-12d0-4034-a8d1-f4657dca59d2 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:34.137081 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-be667ab6-12d0-4034-a8d1-f4657dca59d2 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1326 microversion: 2.1 time: 0.933035 May 26 16:41:34.138471 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 46/89] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:33 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1326 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:34.217261 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-671464db-4b4d-45a8-91b8-11c89fb872c6 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:34.218426 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-671464db-4b4d-45a8-91b8-11c89fb872c6 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:34.228276 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-671464db-4b4d-45a8-91b8-11c89fb872c6 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:34.229506 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-671464db-4b4d-45a8-91b8-11c89fb872c6 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:34.230519 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-671464db-4b4d-45a8-91b8-11c89fb872c6 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:34.232283 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-671464db-4b4d-45a8-91b8-11c89fb872c6 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:34.443507 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e8d35011-cd08-46ca-895f-1983b8cfe68b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:34.444139 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e8d35011-cd08-46ca-895f-1983b8cfe68b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:34.459549 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e8d35011-cd08-46ca-895f-1983b8cfe68b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:34.460158 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e8d35011-cd08-46ca-895f-1983b8cfe68b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:34.461798 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e8d35011-cd08-46ca-895f-1983b8cfe68b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:34.471546 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e8d35011-cd08-46ca-895f-1983b8cfe68b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:35.278819 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-671464db-4b4d-45a8-91b8-11c89fb872c6 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:35.324621 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e8d35011-cd08-46ca-895f-1983b8cfe68b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:35.355961 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-671464db-4b4d-45a8-91b8-11c89fb872c6 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1319 microversion: 2.1 time: 1.146148 May 26 16:41:35.356846 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e8d35011-cd08-46ca-895f-1983b8cfe68b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:35.360958 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 44/90] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:34 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1319 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:35.363192 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e8d35011-cd08-46ca-895f-1983b8cfe68b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:35.372727 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e8d35011-cd08-46ca-895f-1983b8cfe68b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1411 microversion: 2.20 time: 0.929189 May 26 16:41:35.387202 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 47/91] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:41:34 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1411 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:41:35.394019 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-36e2b678-92d0-487f-ae7d-c9cd9fab9e74 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:35.394645 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-36e2b678-92d0-487f-ae7d-c9cd9fab9e74 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:35.401842 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-50e7b426-cc33-4ed8-b8a9-baa9d8dccc7e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:35.402927 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-50e7b426-cc33-4ed8-b8a9-baa9d8dccc7e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:35.415668 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-36e2b678-92d0-487f-ae7d-c9cd9fab9e74 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:35.416125 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-36e2b678-92d0-487f-ae7d-c9cd9fab9e74 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:35.419383 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-50e7b426-cc33-4ed8-b8a9-baa9d8dccc7e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:35.420143 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-50e7b426-cc33-4ed8-b8a9-baa9d8dccc7e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:35.421234 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-50e7b426-cc33-4ed8-b8a9-baa9d8dccc7e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:35.423642 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-50e7b426-cc33-4ed8-b8a9-baa9d8dccc7e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:35.428587 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-36e2b678-92d0-487f-ae7d-c9cd9fab9e74 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:35.429075 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-36e2b678-92d0-487f-ae7d-c9cd9fab9e74 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:36.147824 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-50e7b426-cc33-4ed8-b8a9-baa9d8dccc7e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:36.156850 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-36e2b678-92d0-487f-ae7d-c9cd9fab9e74 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:36.168881 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-36e2b678-92d0-487f-ae7d-c9cd9fab9e74 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1366 microversion: 2.1 time: 0.806534 May 26 16:41:36.187515 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 45/92] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:35 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1366 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:36.203059 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-50e7b426-cc33-4ed8-b8a9-baa9d8dccc7e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1326 microversion: 2.1 time: 0.811393 May 26 16:41:36.205028 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 48/93] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:35 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1326 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:36.379951 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-93676a46-0274-46a7-9a3d-6c80afe6d3e6 req-d9e6362f-cd24-423d-b0b7-9dc54723f133 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a636d450-9d10-45a5-9982-9e10393fc4a9", "tag": "444eb6a1-a511-4e39-a006-252d0ba39886"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:41:36.391837 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-80f97593-d7c2-4e61-988c-008e5593904b tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:36.392637 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-80f97593-d7c2-4e61-988c-008e5593904b tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:36.401226 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-93676a46-0274-46a7-9a3d-6c80afe6d3e6 req-d9e6362f-cd24-423d-b0b7-9dc54723f133 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:36.406976 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-80f97593-d7c2-4e61-988c-008e5593904b tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:36.407285 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-80f97593-d7c2-4e61-988c-008e5593904b tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:36.407535 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-93676a46-0274-46a7-9a3d-6c80afe6d3e6 req-d9e6362f-cd24-423d-b0b7-9dc54723f133 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:36.411427 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-80f97593-d7c2-4e61-988c-008e5593904b tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:36.411886 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-80f97593-d7c2-4e61-988c-008e5593904b tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:36.448576 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-93676a46-0274-46a7-9a3d-6c80afe6d3e6 req-d9e6362f-cd24-423d-b0b7-9dc54723f133 service nova] Creating event network-changed:444eb6a1-a511-4e39-a006-252d0ba39886 for instance a636d450-9d10-45a5-9982-9e10393fc4a9 on hv-cinder-83607 May 26 16:41:36.464591 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-93676a46-0274-46a7-9a3d-6c80afe6d3e6 req-d9e6362f-cd24-423d-b0b7-9dc54723f133 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088460 May 26 16:41:36.465750 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 46/94] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:41:36.471558 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-0a9dacc7-cb42-4aff-8e25-d23d9b1e356e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:36.478514 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-0a9dacc7-cb42-4aff-8e25-d23d9b1e356e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:36.498780 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0a9dacc7-cb42-4aff-8e25-d23d9b1e356e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:36.499543 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0a9dacc7-cb42-4aff-8e25-d23d9b1e356e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:36.504585 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0a9dacc7-cb42-4aff-8e25-d23d9b1e356e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:36.506720 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0a9dacc7-cb42-4aff-8e25-d23d9b1e356e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:36.888673 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-80f97593-d7c2-4e61-988c-008e5593904b tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:36.939008 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-80f97593-d7c2-4e61-988c-008e5593904b tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1319 microversion: 2.1 time: 0.542245 May 26 16:41:36.957556 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 49/95] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:36 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1319 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:37.091613 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-0a9dacc7-cb42-4aff-8e25-d23d9b1e356e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:37.110195 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-0a9dacc7-cb42-4aff-8e25-d23d9b1e356e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:37.111939 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-0a9dacc7-cb42-4aff-8e25-d23d9b1e356e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:37.114485 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-0a9dacc7-cb42-4aff-8e25-d23d9b1e356e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1411 microversion: 2.20 time: 0.647349 May 26 16:41:37.121701 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 47/96] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:41:36 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1411 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:41:37.198922 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9d2a5771-0ae1-453c-8188-87c8b28750ec tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:37.199567 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9d2a5771-0ae1-453c-8188-87c8b28750ec tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:37.219547 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9d2a5771-0ae1-453c-8188-87c8b28750ec tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:37.220145 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9d2a5771-0ae1-453c-8188-87c8b28750ec tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:37.220972 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9d2a5771-0ae1-453c-8188-87c8b28750ec tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:37.221421 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9d2a5771-0ae1-453c-8188-87c8b28750ec tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:37.235605 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-d3847e6b-276e-4d1e-a899-5b9e2376a6d8 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:37.236225 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-d3847e6b-276e-4d1e-a899-5b9e2376a6d8 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:37.254742 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d3847e6b-276e-4d1e-a899-5b9e2376a6d8 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:37.255285 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d3847e6b-276e-4d1e-a899-5b9e2376a6d8 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:37.263079 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d3847e6b-276e-4d1e-a899-5b9e2376a6d8 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:37.263599 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d3847e6b-276e-4d1e-a899-5b9e2376a6d8 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:37.637411 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9d2a5771-0ae1-453c-8188-87c8b28750ec tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:37.645550 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9d2a5771-0ae1-453c-8188-87c8b28750ec tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1366 microversion: 2.1 time: 0.452823 May 26 16:41:37.657349 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 50/97] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:37 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1366 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:37.657908 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-d3847e6b-276e-4d1e-a899-5b9e2376a6d8 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:37.677322 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-d3847e6b-276e-4d1e-a899-5b9e2376a6d8 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1326 microversion: 2.1 time: 0.446642 May 26 16:41:37.678521 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 48/98] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:37 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1326 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:41:37.978377 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-519e1d2f-ff76-451b-b581-e201b64c5750 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:37.979587 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-519e1d2f-ff76-451b-b581-e201b64c5750 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:37.999343 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-519e1d2f-ff76-451b-b581-e201b64c5750 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:38.002148 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-519e1d2f-ff76-451b-b581-e201b64c5750 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:38.005713 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-519e1d2f-ff76-451b-b581-e201b64c5750 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:38.007097 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-519e1d2f-ff76-451b-b581-e201b64c5750 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:38.142508 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-e8b9ddfd-6306-4db8-98d6-5750e1fa52b0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:38.143633 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-e8b9ddfd-6306-4db8-98d6-5750e1fa52b0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:38.175865 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e8b9ddfd-6306-4db8-98d6-5750e1fa52b0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:38.176608 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e8b9ddfd-6306-4db8-98d6-5750e1fa52b0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:38.193012 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e8b9ddfd-6306-4db8-98d6-5750e1fa52b0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:38.197198 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e8b9ddfd-6306-4db8-98d6-5750e1fa52b0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:38.400008 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-519e1d2f-ff76-451b-b581-e201b64c5750 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:38.418796 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-519e1d2f-ff76-451b-b581-e201b64c5750 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1319 microversion: 2.1 time: 0.453124 May 26 16:41:38.426643 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 51/99] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:37 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1319 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:38.551714 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-5938b978-d775-417a-acf5-72b962fac292 req-26c64837-a300-457e-bfdf-6e20d555df13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1d7f247-4a0f-43cb-893b-a937419b4c4c", "tag": "6fd3d120-3db3-487b-bcb0-b0f1546bac7d"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:41:38.598393 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-5938b978-d775-417a-acf5-72b962fac292 req-26c64837-a300-457e-bfdf-6e20d555df13 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:38.600010 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-5938b978-d775-417a-acf5-72b962fac292 req-26c64837-a300-457e-bfdf-6e20d555df13 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:38.651745 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-5938b978-d775-417a-acf5-72b962fac292 req-26c64837-a300-457e-bfdf-6e20d555df13 service nova] Creating event network-changed:6fd3d120-3db3-487b-bcb0-b0f1546bac7d for instance d1d7f247-4a0f-43cb-893b-a937419b4c4c on hv-cinder-83607 May 26 16:41:38.663800 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-5938b978-d775-417a-acf5-72b962fac292 req-26c64837-a300-457e-bfdf-6e20d555df13 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117521 May 26 16:41:38.664830 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 52/100] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:41:38.697393 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3d4c360b-53ba-4879-a409-f08ce4d8cfa1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:38.699002 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-3d4c360b-53ba-4879-a409-f08ce4d8cfa1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:38.718067 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3d4c360b-53ba-4879-a409-f08ce4d8cfa1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:38.718799 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3d4c360b-53ba-4879-a409-f08ce4d8cfa1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:38.719796 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3d4c360b-53ba-4879-a409-f08ce4d8cfa1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:38.722835 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3d4c360b-53ba-4879-a409-f08ce4d8cfa1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:38.727753 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-e8b9ddfd-6306-4db8-98d6-5750e1fa52b0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:38.750889 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-e8b9ddfd-6306-4db8-98d6-5750e1fa52b0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:38.788105 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-e8b9ddfd-6306-4db8-98d6-5750e1fa52b0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:38.794261 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-e8b9ddfd-6306-4db8-98d6-5750e1fa52b0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1411 microversion: 2.20 time: 0.657741 May 26 16:41:38.795175 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 49/101] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:41:38 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1411 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:41:38.813811 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-c81f661a-2998-4322-be5d-eaa05a48c95d tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:38.814817 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-c81f661a-2998-4322-be5d-eaa05a48c95d tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:38.825147 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c81f661a-2998-4322-be5d-eaa05a48c95d tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:38.825979 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c81f661a-2998-4322-be5d-eaa05a48c95d tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:38.827357 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c81f661a-2998-4322-be5d-eaa05a48c95d tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:38.828324 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c81f661a-2998-4322-be5d-eaa05a48c95d tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:39.543442 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3d4c360b-53ba-4879-a409-f08ce4d8cfa1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:39.556511 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-c81f661a-2998-4322-be5d-eaa05a48c95d tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:39.560761 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-3d4c360b-53ba-4879-a409-f08ce4d8cfa1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1366 microversion: 2.1 time: 0.892680 May 26 16:41:39.565495 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-c81f661a-2998-4322-be5d-eaa05a48c95d tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1326 microversion: 2.1 time: 0.758622 May 26 16:41:39.569583 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 50/102] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:38 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1326 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:39.577275 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 53/103] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:38 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1366 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:39.583324 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-3d2b3aa1-454e-4c6f-b094-b8b4eb99c72a tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:39.584013 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-3d2b3aa1-454e-4c6f-b094-b8b4eb99c72a tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:39.599623 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3d2b3aa1-454e-4c6f-b094-b8b4eb99c72a tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:39.600093 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3d2b3aa1-454e-4c6f-b094-b8b4eb99c72a tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:39.606557 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3d2b3aa1-454e-4c6f-b094-b8b4eb99c72a tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:39.623020 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3d2b3aa1-454e-4c6f-b094-b8b4eb99c72a tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:39.654514 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-53c6d353-4bd7-4326-8f90-2a7aaaec18f0 req-143062a0-4303-4f36-ba96-c7dbaaef9fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15756f2d-4f17-4b50-b02e-4cf50051ec29", "tag": "64f50be8-9caf-42c2-88ea-4042b60bcf83"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:41:39.672362 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-53c6d353-4bd7-4326-8f90-2a7aaaec18f0 req-143062a0-4303-4f36-ba96-c7dbaaef9fb9 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:39.674182 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-53c6d353-4bd7-4326-8f90-2a7aaaec18f0 req-143062a0-4303-4f36-ba96-c7dbaaef9fb9 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:39.719104 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-53c6d353-4bd7-4326-8f90-2a7aaaec18f0 req-143062a0-4303-4f36-ba96-c7dbaaef9fb9 service nova] Creating event network-changed:64f50be8-9caf-42c2-88ea-4042b60bcf83 for instance 15756f2d-4f17-4b50-b02e-4cf50051ec29 on hv-cinder-83607 May 26 16:41:39.738793 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-53c6d353-4bd7-4326-8f90-2a7aaaec18f0 req-143062a0-4303-4f36-ba96-c7dbaaef9fb9 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091167 May 26 16:41:39.747883 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 54/104] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:41:39.823874 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8ce6a76e-257d-41a7-9525-8f82e25d73de tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:39.828658 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-8ce6a76e-257d-41a7-9525-8f82e25d73de tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:39.857492 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8ce6a76e-257d-41a7-9525-8f82e25d73de tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:39.858524 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8ce6a76e-257d-41a7-9525-8f82e25d73de tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:39.861691 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8ce6a76e-257d-41a7-9525-8f82e25d73de tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:39.862524 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8ce6a76e-257d-41a7-9525-8f82e25d73de tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:40.075861 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-3d2b3aa1-454e-4c6f-b094-b8b4eb99c72a tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:40.099178 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-3d2b3aa1-454e-4c6f-b094-b8b4eb99c72a tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1319 microversion: 2.1 time: 0.528416 May 26 16:41:40.103007 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 51/105] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:39 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1319 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:40.219470 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8ce6a76e-257d-41a7-9525-8f82e25d73de tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:40.229141 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8ce6a76e-257d-41a7-9525-8f82e25d73de tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:40.230766 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8ce6a76e-257d-41a7-9525-8f82e25d73de tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:40.231936 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-8ce6a76e-257d-41a7-9525-8f82e25d73de tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1411 microversion: 2.20 time: 0.418741 May 26 16:41:40.232911 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 55/106] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:41:39 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1411 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:41:40.594768 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-fa0bf53e-3fe0-4ce3-9f5f-cfbd5dd2cf9a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:40.597324 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-fa0bf53e-3fe0-4ce3-9f5f-cfbd5dd2cf9a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:40.604287 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-61847561-d33c-4732-8cf3-5222ce0f915b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:40.605126 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-61847561-d33c-4732-8cf3-5222ce0f915b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:40.612608 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fa0bf53e-3fe0-4ce3-9f5f-cfbd5dd2cf9a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:40.614096 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fa0bf53e-3fe0-4ce3-9f5f-cfbd5dd2cf9a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:40.614374 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-61847561-d33c-4732-8cf3-5222ce0f915b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:40.616215 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-61847561-d33c-4732-8cf3-5222ce0f915b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:40.617036 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fa0bf53e-3fe0-4ce3-9f5f-cfbd5dd2cf9a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:40.617339 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-61847561-d33c-4732-8cf3-5222ce0f915b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:40.617747 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-61847561-d33c-4732-8cf3-5222ce0f915b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:40.619176 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fa0bf53e-3fe0-4ce3-9f5f-cfbd5dd2cf9a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:41.533658 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-61847561-d33c-4732-8cf3-5222ce0f915b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:41.552666 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-61847561-d33c-4732-8cf3-5222ce0f915b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1326 microversion: 2.1 time: 0.952045 May 26 16:41:41.563539 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 56/107] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:40 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1326 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:41:41.825262 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:41.827506 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell0:SELECT=22 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:41.878412 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-fa0bf53e-3fe0-4ce3-9f5f-cfbd5dd2cf9a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:41.902410 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-fa0bf53e-3fe0-4ce3-9f5f-cfbd5dd2cf9a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1366 microversion: 2.1 time: 1.317038 May 26 16:41:41.903946 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 52/108] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:40 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1366 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:41.911939 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-4a4a46eb-080e-4e07-b813-e1a32af7acf9 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:41.912839 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-4a4a46eb-080e-4e07-b813-e1a32af7acf9 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:41.923555 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4a4a46eb-080e-4e07-b813-e1a32af7acf9 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:41.924422 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4a4a46eb-080e-4e07-b813-e1a32af7acf9 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:41.925988 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4a4a46eb-080e-4e07-b813-e1a32af7acf9 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:41.926906 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4a4a46eb-080e-4e07-b813-e1a32af7acf9 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:42.179315 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-e458bcce-42da-467e-9dfd-2c164c0f7525 req-3b4aa72e-ab00-4f7e-a632-ccae7ca7fa70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a691d98-aaca-4c24-9200-19517540e68e", "name": "network-vif-plugged", "status": "completed", "tag": "410fa846-df15-41e9-907f-35655843eded"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:41:42.202435 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-e458bcce-42da-467e-9dfd-2c164c0f7525 req-3b4aa72e-ab00-4f7e-a632-ccae7ca7fa70 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:42.206337 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-e458bcce-42da-467e-9dfd-2c164c0f7525 req-3b4aa72e-ab00-4f7e-a632-ccae7ca7fa70 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:42.242034 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-e458bcce-42da-467e-9dfd-2c164c0f7525 req-3b4aa72e-ab00-4f7e-a632-ccae7ca7fa70 service nova] Creating event network-vif-plugged:410fa846-df15-41e9-907f-35655843eded for instance 6a691d98-aaca-4c24-9200-19517540e68e on hv-cinder-83607 May 26 16:41:42.251168 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-e458bcce-42da-467e-9dfd-2c164c0f7525 req-3b4aa72e-ab00-4f7e-a632-ccae7ca7fa70 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.685779 May 26 16:41:42.252098 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 57/109] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:41:42.263286 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-50dc4e3b-3222-4bf8-8655-a6a1f5240de2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:42.264632 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-50dc4e3b-3222-4bf8-8655-a6a1f5240de2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:42.304583 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-50dc4e3b-3222-4bf8-8655-a6a1f5240de2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:42.304583 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-50dc4e3b-3222-4bf8-8655-a6a1f5240de2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:42.304583 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-50dc4e3b-3222-4bf8-8655-a6a1f5240de2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:42.304583 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-50dc4e3b-3222-4bf8-8655-a6a1f5240de2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:42.369071 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell0:SELECT=6 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:42.409588 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-4a4a46eb-080e-4e07-b813-e1a32af7acf9 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:42.448331 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-4a4a46eb-080e-4e07-b813-e1a32af7acf9 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1319 microversion: 2.1 time: 0.539186 May 26 16:41:42.452658 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 53/110] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:41 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1319 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:42.562628 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-50dc4e3b-3222-4bf8-8655-a6a1f5240de2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:42.574251 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-50dc4e3b-3222-4bf8-8655-a6a1f5240de2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:42.575305 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-001dc7a8-47de-4bc3-bca8-17c43084091c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:42.576148 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-001dc7a8-47de-4bc3-bca8-17c43084091c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:42.576748 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-50dc4e3b-3222-4bf8-8655-a6a1f5240de2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:42.578272 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-50dc4e3b-3222-4bf8-8655-a6a1f5240de2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1411 microversion: 2.20 time: 0.324993 May 26 16:41:42.579026 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 58/111] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:41:42 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1411 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:41:42.590866 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-001dc7a8-47de-4bc3-bca8-17c43084091c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:42.592391 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-001dc7a8-47de-4bc3-bca8-17c43084091c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:42.597214 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-001dc7a8-47de-4bc3-bca8-17c43084091c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:42.597214 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-001dc7a8-47de-4bc3-bca8-17c43084091c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:42.816270 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-001dc7a8-47de-4bc3-bca8-17c43084091c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:42.828077 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-001dc7a8-47de-4bc3-bca8-17c43084091c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1326 microversion: 2.1 time: 0.260285 May 26 16:41:42.840465 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 54/112] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:42 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1326 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:42.922895 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-83cba294-fe66-41a3-bcac-4ac1eee7b210 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:42.924144 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-83cba294-fe66-41a3-bcac-4ac1eee7b210 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:42.932864 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-83cba294-fe66-41a3-bcac-4ac1eee7b210 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:42.933571 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-83cba294-fe66-41a3-bcac-4ac1eee7b210 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:42.934779 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-83cba294-fe66-41a3-bcac-4ac1eee7b210 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:42.935230 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-83cba294-fe66-41a3-bcac-4ac1eee7b210 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:43.095792 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-83cba294-fe66-41a3-bcac-4ac1eee7b210 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:43.102472 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-83cba294-fe66-41a3-bcac-4ac1eee7b210 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1366 microversion: 2.1 time: 0.185002 May 26 16:41:43.103290 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 59/113] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:42 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:41:43.471698 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-2049951e-ca44-4b88-a3ff-2cfce4843976 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:43.472864 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-2049951e-ca44-4b88-a3ff-2cfce4843976 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:43.481492 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2049951e-ca44-4b88-a3ff-2cfce4843976 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:43.482862 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2049951e-ca44-4b88-a3ff-2cfce4843976 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:43.484730 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2049951e-ca44-4b88-a3ff-2cfce4843976 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:43.485954 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2049951e-ca44-4b88-a3ff-2cfce4843976 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:43.600138 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7e399477-1df9-4a78-b3e6-a43691dd3031 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:43.601198 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-7e399477-1df9-4a78-b3e6-a43691dd3031 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:43.614602 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7e399477-1df9-4a78-b3e6-a43691dd3031 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:43.614602 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7e399477-1df9-4a78-b3e6-a43691dd3031 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:43.614602 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7e399477-1df9-4a78-b3e6-a43691dd3031 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:43.614602 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7e399477-1df9-4a78-b3e6-a43691dd3031 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:43.714745 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-2049951e-ca44-4b88-a3ff-2cfce4843976 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:43.724919 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-2049951e-ca44-4b88-a3ff-2cfce4843976 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1319 microversion: 2.1 time: 0.257972 May 26 16:41:43.725835 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 55/114] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:43 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:43.811171 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7e399477-1df9-4a78-b3e6-a43691dd3031 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:43.824580 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7e399477-1df9-4a78-b3e6-a43691dd3031 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:43.826170 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7e399477-1df9-4a78-b3e6-a43691dd3031 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:43.827347 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7e399477-1df9-4a78-b3e6-a43691dd3031 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1411 microversion: 2.20 time: 0.234230 May 26 16:41:43.827947 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 60/115] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:41:43 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1411 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:41:43.849245 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-0b0c42c2-4665-462c-9892-9f721f3eaaa7 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:43.850352 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-0b0c42c2-4665-462c-9892-9f721f3eaaa7 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:43.857646 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0b0c42c2-4665-462c-9892-9f721f3eaaa7 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:43.858096 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0b0c42c2-4665-462c-9892-9f721f3eaaa7 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:43.858889 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0b0c42c2-4665-462c-9892-9f721f3eaaa7 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:43.859323 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0b0c42c2-4665-462c-9892-9f721f3eaaa7 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:44.045619 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-0b0c42c2-4665-462c-9892-9f721f3eaaa7 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:44.062692 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-0b0c42c2-4665-462c-9892-9f721f3eaaa7 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1326 microversion: 2.1 time: 0.219786 May 26 16:41:44.063387 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 56/116] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:43 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1326 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:44.119964 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-86c6f48f-0b15-47f4-ac71-f7c5c7ce352b tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:44.120634 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-86c6f48f-0b15-47f4-ac71-f7c5c7ce352b tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:44.128415 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-86c6f48f-0b15-47f4-ac71-f7c5c7ce352b tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:44.129607 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-86c6f48f-0b15-47f4-ac71-f7c5c7ce352b tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:44.131095 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-86c6f48f-0b15-47f4-ac71-f7c5c7ce352b tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:44.131908 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-86c6f48f-0b15-47f4-ac71-f7c5c7ce352b tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:44.341860 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-86c6f48f-0b15-47f4-ac71-f7c5c7ce352b tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:44.341860 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=100 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:44.347222 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-86c6f48f-0b15-47f4-ac71-f7c5c7ce352b tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1366 microversion: 2.1 time: 0.231392 May 26 16:41:44.348334 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 61/117] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:44 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:44.754244 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-edbb11d2-ba4b-4d3a-9121-482370bfffaa tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:44.755274 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-edbb11d2-ba4b-4d3a-9121-482370bfffaa tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:44.766280 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-edbb11d2-ba4b-4d3a-9121-482370bfffaa tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:44.767092 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-edbb11d2-ba4b-4d3a-9121-482370bfffaa tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:44.768593 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-edbb11d2-ba4b-4d3a-9121-482370bfffaa tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:44.769378 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-edbb11d2-ba4b-4d3a-9121-482370bfffaa tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:44.798729 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=100 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:44.860908 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f3bfbed7-b751-4442-9d97-281b8becdb1e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:44.861702 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f3bfbed7-b751-4442-9d97-281b8becdb1e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:44.872811 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f3bfbed7-b751-4442-9d97-281b8becdb1e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:44.873515 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f3bfbed7-b751-4442-9d97-281b8becdb1e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:44.874806 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f3bfbed7-b751-4442-9d97-281b8becdb1e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:44.875618 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f3bfbed7-b751-4442-9d97-281b8becdb1e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:45.030213 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-edbb11d2-ba4b-4d3a-9121-482370bfffaa tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:45.038688 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-edbb11d2-ba4b-4d3a-9121-482370bfffaa tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1319 microversion: 2.1 time: 0.290312 May 26 16:41:45.039277 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 57/118] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:44 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:45.077189 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f3bfbed7-b751-4442-9d97-281b8becdb1e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:45.082176 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-2771fe3c-9eee-4f42-93fa-508e3c733f65 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:45.083259 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-2771fe3c-9eee-4f42-93fa-508e3c733f65 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:45.086008 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f3bfbed7-b751-4442-9d97-281b8becdb1e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:45.087852 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f3bfbed7-b751-4442-9d97-281b8becdb1e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:45.089153 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f3bfbed7-b751-4442-9d97-281b8becdb1e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1411 microversion: 2.20 time: 0.237453 May 26 16:41:45.089734 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 62/119] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:41:44 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1411 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:41:45.090622 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2771fe3c-9eee-4f42-93fa-508e3c733f65 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:45.091335 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2771fe3c-9eee-4f42-93fa-508e3c733f65 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:45.092306 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2771fe3c-9eee-4f42-93fa-508e3c733f65 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:45.092949 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2771fe3c-9eee-4f42-93fa-508e3c733f65 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:45.234377 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-2771fe3c-9eee-4f42-93fa-508e3c733f65 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:45.243286 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-2771fe3c-9eee-4f42-93fa-508e3c733f65 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1326 microversion: 2.1 time: 0.165568 May 26 16:41:45.243884 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 58/120] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:45 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1326 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:41:45.366097 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-4eac29e1-e7f4-40db-b692-9cacc715cc6c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:45.366707 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-4eac29e1-e7f4-40db-b692-9cacc715cc6c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:45.373671 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4eac29e1-e7f4-40db-b692-9cacc715cc6c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:45.374122 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4eac29e1-e7f4-40db-b692-9cacc715cc6c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:45.374901 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4eac29e1-e7f4-40db-b692-9cacc715cc6c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:45.375340 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4eac29e1-e7f4-40db-b692-9cacc715cc6c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:45.527240 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-4eac29e1-e7f4-40db-b692-9cacc715cc6c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:45.536527 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-4eac29e1-e7f4-40db-b692-9cacc715cc6c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1366 microversion: 2.1 time: 0.174161 May 26 16:41:45.537204 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 63/121] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:45 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:46.068229 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-04f325bd-4034-4b05-b976-79e5a1416819 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:46.069411 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-04f325bd-4034-4b05-b976-79e5a1416819 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:46.081947 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-04f325bd-4034-4b05-b976-79e5a1416819 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:46.082740 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-04f325bd-4034-4b05-b976-79e5a1416819 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:46.084077 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-04f325bd-4034-4b05-b976-79e5a1416819 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:46.084918 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-04f325bd-4034-4b05-b976-79e5a1416819 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:46.108960 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-677ad766-7b5c-4024-bbf4-e3eb88a5d5e0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:46.109607 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-677ad766-7b5c-4024-bbf4-e3eb88a5d5e0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:46.117552 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-677ad766-7b5c-4024-bbf4-e3eb88a5d5e0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:46.118075 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-677ad766-7b5c-4024-bbf4-e3eb88a5d5e0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:46.118904 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-677ad766-7b5c-4024-bbf4-e3eb88a5d5e0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:46.119347 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-677ad766-7b5c-4024-bbf4-e3eb88a5d5e0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:46.336584 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-04f325bd-4034-4b05-b976-79e5a1416819 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:46.338570 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-677ad766-7b5c-4024-bbf4-e3eb88a5d5e0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:46.349389 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-677ad766-7b5c-4024-bbf4-e3eb88a5d5e0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:46.351447 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-677ad766-7b5c-4024-bbf4-e3eb88a5d5e0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:46.351603 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-04f325bd-4034-4b05-b976-79e5a1416819 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1319 microversion: 2.1 time: 0.291217 May 26 16:41:46.353084 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 59/122] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:46 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:46.353888 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-677ad766-7b5c-4024-bbf4-e3eb88a5d5e0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1411 microversion: 2.20 time: 0.249247 May 26 16:41:46.356449 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 64/123] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:41:46 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1411 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:41:46.361660 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-332e83d3-0770-45dd-b03e-496efe79d588 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:46.362790 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-332e83d3-0770-45dd-b03e-496efe79d588 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:46.374072 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-332e83d3-0770-45dd-b03e-496efe79d588 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:46.374871 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-332e83d3-0770-45dd-b03e-496efe79d588 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:46.376272 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-332e83d3-0770-45dd-b03e-496efe79d588 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:46.377109 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-332e83d3-0770-45dd-b03e-496efe79d588 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:46.544190 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-332e83d3-0770-45dd-b03e-496efe79d588 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:46.553561 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-332e83d3-0770-45dd-b03e-496efe79d588 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1326 microversion: 2.1 time: 0.198894 May 26 16:41:46.554350 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 60/124] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:46 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1326 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:46.555806 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-c4062dd5-857c-4706-baf3-0d66184f7c97 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:46.556851 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-c4062dd5-857c-4706-baf3-0d66184f7c97 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:46.564427 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c4062dd5-857c-4706-baf3-0d66184f7c97 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:46.565086 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c4062dd5-857c-4706-baf3-0d66184f7c97 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:46.565962 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c4062dd5-857c-4706-baf3-0d66184f7c97 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:46.566755 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c4062dd5-857c-4706-baf3-0d66184f7c97 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:46.832513 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c4062dd5-857c-4706-baf3-0d66184f7c97 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:46.845621 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-c4062dd5-857c-4706-baf3-0d66184f7c97 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1366 microversion: 2.1 time: 0.294404 May 26 16:41:46.846409 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 65/125] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:46 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:41:47.372858 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-990b6bff-6fd5-4625-931a-a4f64cc22ef8 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:47.373721 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-990b6bff-6fd5-4625-931a-a4f64cc22ef8 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:47.373878 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1aa55d69-de38-4f2f-8a11-e46274b65ab6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:47.374329 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1aa55d69-de38-4f2f-8a11-e46274b65ab6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:47.380447 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-990b6bff-6fd5-4625-931a-a4f64cc22ef8 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:47.380968 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-990b6bff-6fd5-4625-931a-a4f64cc22ef8 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:47.381178 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1aa55d69-de38-4f2f-8a11-e46274b65ab6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:47.381453 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1aa55d69-de38-4f2f-8a11-e46274b65ab6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:47.381750 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-990b6bff-6fd5-4625-931a-a4f64cc22ef8 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:47.382188 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-990b6bff-6fd5-4625-931a-a4f64cc22ef8 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:47.382382 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1aa55d69-de38-4f2f-8a11-e46274b65ab6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:47.382680 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1aa55d69-de38-4f2f-8a11-e46274b65ab6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:47.686299 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-990b6bff-6fd5-4625-931a-a4f64cc22ef8 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:47.694210 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1aa55d69-de38-4f2f-8a11-e46274b65ab6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:47.699762 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-990b6bff-6fd5-4625-931a-a4f64cc22ef8 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1319 microversion: 2.1 time: 0.331445 May 26 16:41:47.700861 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 61/126] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:47 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1319 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:47.709395 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-df1b4a59-ba04-425b-8722-df2a527cc773 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:47.710177 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1aa55d69-de38-4f2f-8a11-e46274b65ab6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:47.710329 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-df1b4a59-ba04-425b-8722-df2a527cc773 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:47.713672 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1aa55d69-de38-4f2f-8a11-e46274b65ab6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:47.716548 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1aa55d69-de38-4f2f-8a11-e46274b65ab6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1411 microversion: 2.20 time: 0.346445 May 26 16:41:47.718433 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 66/127] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:41:47 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1411 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:41:47.735399 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-df1b4a59-ba04-425b-8722-df2a527cc773 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:47.737247 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-df1b4a59-ba04-425b-8722-df2a527cc773 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:47.738812 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-df1b4a59-ba04-425b-8722-df2a527cc773 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:47.739625 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-df1b4a59-ba04-425b-8722-df2a527cc773 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:47.869328 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2f026f19-4015-40e5-9f44-e8ee3ea7d7e4 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:47.870446 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2f026f19-4015-40e5-9f44-e8ee3ea7d7e4 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:47.883797 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2f026f19-4015-40e5-9f44-e8ee3ea7d7e4 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:47.884855 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2f026f19-4015-40e5-9f44-e8ee3ea7d7e4 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:47.886400 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2f026f19-4015-40e5-9f44-e8ee3ea7d7e4 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:47.887353 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2f026f19-4015-40e5-9f44-e8ee3ea7d7e4 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:47.966925 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-df1b4a59-ba04-425b-8722-df2a527cc773 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:47.996942 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-df1b4a59-ba04-425b-8722-df2a527cc773 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1326 microversion: 2.1 time: 0.293730 May 26 16:41:47.997738 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 62/128] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:47 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1326 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:48.118760 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-2f026f19-4015-40e5-9f44-e8ee3ea7d7e4 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:48.127239 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2f026f19-4015-40e5-9f44-e8ee3ea7d7e4 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1366 microversion: 2.1 time: 0.267048 May 26 16:41:48.127956 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 67/129] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:47 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:41:48.730304 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-afdf04df-01c3-4132-a7c5-2eede768ecf7 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:48.731244 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-afdf04df-01c3-4132-a7c5-2eede768ecf7 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:48.742610 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-afdf04df-01c3-4132-a7c5-2eede768ecf7 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:48.743408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3df4b065-cd43-477f-87f8-e1a3e451e05a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:48.743904 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-afdf04df-01c3-4132-a7c5-2eede768ecf7 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:48.744840 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-3df4b065-cd43-477f-87f8-e1a3e451e05a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:48.744987 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-afdf04df-01c3-4132-a7c5-2eede768ecf7 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:48.745643 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-afdf04df-01c3-4132-a7c5-2eede768ecf7 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:48.752649 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3df4b065-cd43-477f-87f8-e1a3e451e05a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:48.753203 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3df4b065-cd43-477f-87f8-e1a3e451e05a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:48.754234 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3df4b065-cd43-477f-87f8-e1a3e451e05a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:48.754717 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3df4b065-cd43-477f-87f8-e1a3e451e05a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:49.004619 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-afdf04df-01c3-4132-a7c5-2eede768ecf7 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:49.016957 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3df4b065-cd43-477f-87f8-e1a3e451e05a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:49.021282 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-afdf04df-01c3-4132-a7c5-2eede768ecf7 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1319 microversion: 2.1 time: 0.297065 May 26 16:41:49.022776 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 63/130] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:48 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1319 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:49.032446 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-4a52f0b9-aacd-4ca8-82ae-f6bf1f1b6472 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:49.033434 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-4a52f0b9-aacd-4ca8-82ae-f6bf1f1b6472 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:49.044812 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4a52f0b9-aacd-4ca8-82ae-f6bf1f1b6472 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:49.045941 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4a52f0b9-aacd-4ca8-82ae-f6bf1f1b6472 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:49.047634 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4a52f0b9-aacd-4ca8-82ae-f6bf1f1b6472 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:49.048225 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3df4b065-cd43-477f-87f8-e1a3e451e05a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:49.048874 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4a52f0b9-aacd-4ca8-82ae-f6bf1f1b6472 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:49.050239 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3df4b065-cd43-477f-87f8-e1a3e451e05a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:49.052328 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-3df4b065-cd43-477f-87f8-e1a3e451e05a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1411 microversion: 2.20 time: 0.314935 May 26 16:41:49.053278 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 68/131] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:41:48 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1411 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:41:49.151893 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0ce8a90d-df26-4f9f-830e-9b9df767fae8 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:49.153887 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0ce8a90d-df26-4f9f-830e-9b9df767fae8 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:49.169705 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0ce8a90d-df26-4f9f-830e-9b9df767fae8 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:49.170401 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0ce8a90d-df26-4f9f-830e-9b9df767fae8 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:49.171410 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0ce8a90d-df26-4f9f-830e-9b9df767fae8 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:49.172011 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0ce8a90d-df26-4f9f-830e-9b9df767fae8 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:49.347088 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-4a52f0b9-aacd-4ca8-82ae-f6bf1f1b6472 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:49.362671 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-4a52f0b9-aacd-4ca8-82ae-f6bf1f1b6472 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1326 microversion: 2.1 time: 0.338008 May 26 16:41:49.363776 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 64/132] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:49 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1326 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:49.413821 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0ce8a90d-df26-4f9f-830e-9b9df767fae8 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:49.422413 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0ce8a90d-df26-4f9f-830e-9b9df767fae8 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1366 microversion: 2.1 time: 0.279866 May 26 16:41:49.423015 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 69/133] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:49 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:41:50.045862 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-3a5b8d87-2588-4a6b-a763-98a06075c34c tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:50.046962 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-3a5b8d87-2588-4a6b-a763-98a06075c34c tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:50.053933 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3a5b8d87-2588-4a6b-a763-98a06075c34c tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:50.054487 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3a5b8d87-2588-4a6b-a763-98a06075c34c tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:50.055864 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3a5b8d87-2588-4a6b-a763-98a06075c34c tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:50.056714 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3a5b8d87-2588-4a6b-a763-98a06075c34c tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:50.074702 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-52909f6b-b88b-4232-9639-77430bf5ab10 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:50.076245 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-52909f6b-b88b-4232-9639-77430bf5ab10 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:50.083936 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-52909f6b-b88b-4232-9639-77430bf5ab10 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:50.084750 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-52909f6b-b88b-4232-9639-77430bf5ab10 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:50.085758 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-52909f6b-b88b-4232-9639-77430bf5ab10 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:50.086371 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-52909f6b-b88b-4232-9639-77430bf5ab10 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:50.405920 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-52909f6b-b88b-4232-9639-77430bf5ab10 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:50.418389 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-52909f6b-b88b-4232-9639-77430bf5ab10 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:50.420584 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-52909f6b-b88b-4232-9639-77430bf5ab10 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:50.422287 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-52909f6b-b88b-4232-9639-77430bf5ab10 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1411 microversion: 2.20 time: 0.352700 May 26 16:41:50.432413 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 70/134] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:41:50 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1411 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:41:50.432747 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-3a5b8d87-2588-4a6b-a763-98a06075c34c tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:50.437196 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f7311495-300f-43f6-9aa4-ff54ead20eb9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:50.438529 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f7311495-300f-43f6-9aa4-ff54ead20eb9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:50.448709 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f7311495-300f-43f6-9aa4-ff54ead20eb9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:50.449224 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f7311495-300f-43f6-9aa4-ff54ead20eb9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:50.450131 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f7311495-300f-43f6-9aa4-ff54ead20eb9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:50.450880 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f7311495-300f-43f6-9aa4-ff54ead20eb9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:50.464647 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-3a5b8d87-2588-4a6b-a763-98a06075c34c tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1319 microversion: 2.1 time: 0.422704 May 26 16:41:50.466051 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 65/135] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:50 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1319 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:41:50.473557 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-da9ebe9c-aad5-466e-a7fe-d5ee9c9899ac tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:50.474743 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-da9ebe9c-aad5-466e-a7fe-d5ee9c9899ac tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:50.490682 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-da9ebe9c-aad5-466e-a7fe-d5ee9c9899ac tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:50.490963 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-da9ebe9c-aad5-466e-a7fe-d5ee9c9899ac tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:50.491959 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-da9ebe9c-aad5-466e-a7fe-d5ee9c9899ac tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:50.492496 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-da9ebe9c-aad5-466e-a7fe-d5ee9c9899ac tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:50.785231 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f7311495-300f-43f6-9aa4-ff54ead20eb9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:50.798197 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f7311495-300f-43f6-9aa4-ff54ead20eb9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1326 microversion: 2.1 time: 0.372552 May 26 16:41:50.799236 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 71/136] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:50 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1326 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:50.811780 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-da9ebe9c-aad5-466e-a7fe-d5ee9c9899ac tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:50.826282 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-da9ebe9c-aad5-466e-a7fe-d5ee9c9899ac tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1366 microversion: 2.1 time: 0.358299 May 26 16:41:50.827385 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 66/137] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:50 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1366 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:51.457530 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6ca02008-037b-4d08-a890-38e33c35dd43 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:51.459925 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-6ca02008-037b-4d08-a890-38e33c35dd43 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:51.472060 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6ca02008-037b-4d08-a890-38e33c35dd43 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:51.472965 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6ca02008-037b-4d08-a890-38e33c35dd43 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:51.474518 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6ca02008-037b-4d08-a890-38e33c35dd43 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:51.475294 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6ca02008-037b-4d08-a890-38e33c35dd43 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:51.502199 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-bb2c0d9f-3fd3-4212-a8df-3621b544421e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:51.503480 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-bb2c0d9f-3fd3-4212-a8df-3621b544421e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:51.511269 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bb2c0d9f-3fd3-4212-a8df-3621b544421e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:51.512057 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bb2c0d9f-3fd3-4212-a8df-3621b544421e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:51.513043 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bb2c0d9f-3fd3-4212-a8df-3621b544421e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:51.513635 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bb2c0d9f-3fd3-4212-a8df-3621b544421e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:51.932989 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6ca02008-037b-4d08-a890-38e33c35dd43 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:51.940193 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-bb2c0d9f-3fd3-4212-a8df-3621b544421e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:51.950449 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6ca02008-037b-4d08-a890-38e33c35dd43 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:51.952078 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6ca02008-037b-4d08-a890-38e33c35dd43 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:51.953429 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6ca02008-037b-4d08-a890-38e33c35dd43 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1411 microversion: 2.20 time: 0.504945 May 26 16:41:51.968407 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 72/138] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:41:51 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1411 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:41:51.968877 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-bb2c0d9f-3fd3-4212-a8df-3621b544421e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1319 microversion: 2.1 time: 0.460508 May 26 16:41:51.968877 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 67/139] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:51 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1319 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:51.968877 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-0bad1534-5aad-43c3-b148-923868a15e30 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:51.969376 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-0bad1534-5aad-43c3-b148-923868a15e30 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:51.982998 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0bad1534-5aad-43c3-b148-923868a15e30 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:51.983818 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-cb9d6050-3d89-40f6-a3c0-f58bed245119 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:51.984416 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0bad1534-5aad-43c3-b148-923868a15e30 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:51.985655 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-cb9d6050-3d89-40f6-a3c0-f58bed245119 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:51.986508 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0bad1534-5aad-43c3-b148-923868a15e30 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:51.987675 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0bad1534-5aad-43c3-b148-923868a15e30 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:51.996506 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cb9d6050-3d89-40f6-a3c0-f58bed245119 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:51.997285 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cb9d6050-3d89-40f6-a3c0-f58bed245119 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:51.998658 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cb9d6050-3d89-40f6-a3c0-f58bed245119 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:51.999381 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cb9d6050-3d89-40f6-a3c0-f58bed245119 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:52.293804 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-cb9d6050-3d89-40f6-a3c0-f58bed245119 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:52.301208 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-0bad1534-5aad-43c3-b148-923868a15e30 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:52.312973 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-cb9d6050-3d89-40f6-a3c0-f58bed245119 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1326 microversion: 2.1 time: 0.356330 May 26 16:41:52.314658 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 73/140] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:51 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1326 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:52.319852 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-0bad1534-5aad-43c3-b148-923868a15e30 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1366 microversion: 2.1 time: 0.359522 May 26 16:41:52.320568 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 68/141] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:51 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1366 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:52.976197 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3c7ac33e-f78b-4d16-9792-c033d72e558f tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:52.979329 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-3c7ac33e-f78b-4d16-9792-c033d72e558f tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:52.984781 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-31660a6d-8826-4959-bf87-4410a9c94c99 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:52.985396 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-31660a6d-8826-4959-bf87-4410a9c94c99 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:53.014847 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-31660a6d-8826-4959-bf87-4410a9c94c99 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:53.021114 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-31660a6d-8826-4959-bf87-4410a9c94c99 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:53.022409 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3c7ac33e-f78b-4d16-9792-c033d72e558f tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:53.023685 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-31660a6d-8826-4959-bf87-4410a9c94c99 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:53.024677 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-31660a6d-8826-4959-bf87-4410a9c94c99 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:53.029263 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3c7ac33e-f78b-4d16-9792-c033d72e558f tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:53.031515 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3c7ac33e-f78b-4d16-9792-c033d72e558f tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:53.035820 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3c7ac33e-f78b-4d16-9792-c033d72e558f tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:53.913310 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3c7ac33e-f78b-4d16-9792-c033d72e558f tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:53.924403 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-31660a6d-8826-4959-bf87-4410a9c94c99 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:53.936454 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-3c7ac33e-f78b-4d16-9792-c033d72e558f tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1319 microversion: 2.1 time: 0.963752 May 26 16:41:53.938412 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-31660a6d-8826-4959-bf87-4410a9c94c99 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:53.940456 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 74/142] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:52 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1319 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:53.942049 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-31660a6d-8826-4959-bf87-4410a9c94c99 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:53.943479 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-31660a6d-8826-4959-bf87-4410a9c94c99 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1411 microversion: 2.20 time: 0.962852 May 26 16:41:53.944389 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 69/143] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:41:52 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1411 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:41:53.950022 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-f3ba570a-1874-412c-9679-8dc715cc4524 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:53.950857 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-f3ba570a-1874-412c-9679-8dc715cc4524 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:53.951049 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-e4972940-088d-48d7-aacd-b26b9807f165 req-5a970cef-253f-462a-8a85-af4726e60c12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bcd849c-2f03-44d0-9c4b-350431056dea", "name": "network-vif-plugged", "status": "completed", "tag": "05f50936-b66b-4d09-b68b-ab827d36742f"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:41:53.959544 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f3ba570a-1874-412c-9679-8dc715cc4524 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:53.960278 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f3ba570a-1874-412c-9679-8dc715cc4524 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:53.961157 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f3ba570a-1874-412c-9679-8dc715cc4524 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:53.962538 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f3ba570a-1874-412c-9679-8dc715cc4524 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:53.987198 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-e4972940-088d-48d7-aacd-b26b9807f165 req-5a970cef-253f-462a-8a85-af4726e60c12 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:53.988112 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-e4972940-088d-48d7-aacd-b26b9807f165 req-5a970cef-253f-462a-8a85-af4726e60c12 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:54.018781 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-e4972940-088d-48d7-aacd-b26b9807f165 req-5a970cef-253f-462a-8a85-af4726e60c12 service nova] Creating event network-vif-plugged:05f50936-b66b-4d09-b68b-ab827d36742f for instance 6bcd849c-2f03-44d0-9c4b-350431056dea on hv-cinder-83607 May 26 16:41:54.036720 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-e4972940-088d-48d7-aacd-b26b9807f165 req-5a970cef-253f-462a-8a85-af4726e60c12 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094525 May 26 16:41:54.037514 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 75/144] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:41:54.045542 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3ac67e61-5963-487c-ab16-7b2209f2f985 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:54.046605 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-3ac67e61-5963-487c-ab16-7b2209f2f985 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:54.056343 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3ac67e61-5963-487c-ab16-7b2209f2f985 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:54.057027 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3ac67e61-5963-487c-ab16-7b2209f2f985 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:54.058103 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3ac67e61-5963-487c-ab16-7b2209f2f985 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:54.058662 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3ac67e61-5963-487c-ab16-7b2209f2f985 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:54.452896 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3ac67e61-5963-487c-ab16-7b2209f2f985 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:54.454106 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-f3ba570a-1874-412c-9679-8dc715cc4524 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:54.464128 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-3ac67e61-5963-487c-ab16-7b2209f2f985 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1366 microversion: 2.1 time: 0.425148 May 26 16:41:54.464776 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 76/145] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:54 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1366 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:54.473877 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-f3ba570a-1874-412c-9679-8dc715cc4524 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1326 microversion: 2.1 time: 0.527858 May 26 16:41:54.485321 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 70/146] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:53 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1326 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:54.968203 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f0dc1484-30e3-4cee-9976-d0ddb392f372 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:54.969145 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f0dc1484-30e3-4cee-9976-d0ddb392f372 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:54.974790 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-d3e46e02-1354-42b9-a604-551121466737 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:54.975307 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-d3e46e02-1354-42b9-a604-551121466737 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:54.989666 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d3e46e02-1354-42b9-a604-551121466737 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:54.990274 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d3e46e02-1354-42b9-a604-551121466737 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:54.991230 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d3e46e02-1354-42b9-a604-551121466737 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:54.991827 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d3e46e02-1354-42b9-a604-551121466737 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:55.027006 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f0dc1484-30e3-4cee-9976-d0ddb392f372 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:55.027733 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f0dc1484-30e3-4cee-9976-d0ddb392f372 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:55.031108 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f0dc1484-30e3-4cee-9976-d0ddb392f372 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:55.032126 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f0dc1484-30e3-4cee-9976-d0ddb392f372 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:55.217900 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-d3e46e02-1354-42b9-a604-551121466737 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:55.229747 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-d3e46e02-1354-42b9-a604-551121466737 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:55.231418 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-d3e46e02-1354-42b9-a604-551121466737 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:55.232828 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-d3e46e02-1354-42b9-a604-551121466737 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1411 microversion: 2.20 time: 0.261956 May 26 16:41:55.233999 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 71/147] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:41:54 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1411 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:41:55.326483 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f0dc1484-30e3-4cee-9976-d0ddb392f372 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:55.340628 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f0dc1484-30e3-4cee-9976-d0ddb392f372 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1319 microversion: 2.1 time: 0.381032 May 26 16:41:55.342605 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 77/148] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:54 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1319 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:41:55.499149 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-d328b99e-6e0e-4c04-af2c-faea824c8b01 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:55.500086 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-d328b99e-6e0e-4c04-af2c-faea824c8b01 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:55.511532 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d328b99e-6e0e-4c04-af2c-faea824c8b01 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:55.512241 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d328b99e-6e0e-4c04-af2c-faea824c8b01 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:55.513721 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d328b99e-6e0e-4c04-af2c-faea824c8b01 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:55.513904 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f7536bb5-5b71-43d9-9f19-60189a00fb6f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:55.514838 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f7536bb5-5b71-43d9-9f19-60189a00fb6f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:55.515161 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d328b99e-6e0e-4c04-af2c-faea824c8b01 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:55.532085 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f7536bb5-5b71-43d9-9f19-60189a00fb6f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:55.533185 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f7536bb5-5b71-43d9-9f19-60189a00fb6f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:55.534777 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f7536bb5-5b71-43d9-9f19-60189a00fb6f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:55.547786 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f7536bb5-5b71-43d9-9f19-60189a00fb6f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:56.261013 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f7536bb5-5b71-43d9-9f19-60189a00fb6f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:56.295889 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-d328b99e-6e0e-4c04-af2c-faea824c8b01 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:56.302460 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f7536bb5-5b71-43d9-9f19-60189a00fb6f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1326 microversion: 2.1 time: 0.783073 May 26 16:41:56.323145 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 78/149] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:55 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1326 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:56.324304 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-d328b99e-6e0e-4c04-af2c-faea824c8b01 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1366 microversion: 2.1 time: 0.825191 May 26 16:41:56.324304 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 72/150] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:55 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1366 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:56.324612 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d81ce41b-e713-4a4d-8dc7-b642d5720d15 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:56.324612 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d81ce41b-e713-4a4d-8dc7-b642d5720d15 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:56.337296 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d81ce41b-e713-4a4d-8dc7-b642d5720d15 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:56.338098 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d81ce41b-e713-4a4d-8dc7-b642d5720d15 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:56.339464 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d81ce41b-e713-4a4d-8dc7-b642d5720d15 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:56.340225 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d81ce41b-e713-4a4d-8dc7-b642d5720d15 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:56.350500 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=100 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:56.364126 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-8bdc5d3f-070c-4920-a203-06d8fe216b40 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:56.365475 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-8bdc5d3f-070c-4920-a203-06d8fe216b40 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:56.372527 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8bdc5d3f-070c-4920-a203-06d8fe216b40 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:56.372985 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8bdc5d3f-070c-4920-a203-06d8fe216b40 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:56.373930 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8bdc5d3f-070c-4920-a203-06d8fe216b40 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:56.374376 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8bdc5d3f-070c-4920-a203-06d8fe216b40 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:57.035162 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-8bdc5d3f-070c-4920-a203-06d8fe216b40 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:57.045550 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-8bdc5d3f-070c-4920-a203-06d8fe216b40 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1319 microversion: 2.1 time: 0.685486 May 26 16:41:57.046319 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 73/151] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:56 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1319 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:57.054520 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d81ce41b-e713-4a4d-8dc7-b642d5720d15 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:57.071999 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d81ce41b-e713-4a4d-8dc7-b642d5720d15 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:57.074009 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d81ce41b-e713-4a4d-8dc7-b642d5720d15 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:57.075550 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d81ce41b-e713-4a4d-8dc7-b642d5720d15 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1411 microversion: 2.20 time: 0.769389 May 26 16:41:57.076512 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 79/152] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:41:56 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1411 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:41:57.339474 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e7d06745-0447-4371-8e10-8bcff547e2e9 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:57.340458 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e7d06745-0447-4371-8e10-8bcff547e2e9 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:57.340813 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-1ce6287b-9457-4c14-9759-d5cd2fd3a619 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:57.341686 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-1ce6287b-9457-4c14-9759-d5cd2fd3a619 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:57.354162 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1ce6287b-9457-4c14-9759-d5cd2fd3a619 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:57.355010 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1ce6287b-9457-4c14-9759-d5cd2fd3a619 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:57.356110 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1ce6287b-9457-4c14-9759-d5cd2fd3a619 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:57.356721 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1ce6287b-9457-4c14-9759-d5cd2fd3a619 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:57.357538 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e7d06745-0447-4371-8e10-8bcff547e2e9 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:57.358095 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e7d06745-0447-4371-8e10-8bcff547e2e9 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:57.359102 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e7d06745-0447-4371-8e10-8bcff547e2e9 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:57.359625 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e7d06745-0447-4371-8e10-8bcff547e2e9 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:57.360536 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=100 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:57.650071 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e7d06745-0447-4371-8e10-8bcff547e2e9 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:57.667120 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e7d06745-0447-4371-8e10-8bcff547e2e9 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1366 microversion: 2.1 time: 0.331235 May 26 16:41:57.668545 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 80/153] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:57 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1366 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:57.671303 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-1ce6287b-9457-4c14-9759-d5cd2fd3a619 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:57.684879 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-1ce6287b-9457-4c14-9759-d5cd2fd3a619 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1326 microversion: 2.1 time: 0.357174 May 26 16:41:57.686227 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 74/154] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:57 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1326 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:57.794865 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-0da956b3-f55b-4b8f-8066-18870e48b34e req-08a864d0-e346-4a4a-9c3c-5d7972ecd47e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1d7f247-4a0f-43cb-893b-a937419b4c4c", "name": "network-vif-plugged", "status": "completed", "tag": "6fd3d120-3db3-487b-bcb0-b0f1546bac7d"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:41:57.818525 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-0da956b3-f55b-4b8f-8066-18870e48b34e req-08a864d0-e346-4a4a-9c3c-5d7972ecd47e service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:57.819431 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-0da956b3-f55b-4b8f-8066-18870e48b34e req-08a864d0-e346-4a4a-9c3c-5d7972ecd47e service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:57.839998 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-0da956b3-f55b-4b8f-8066-18870e48b34e req-08a864d0-e346-4a4a-9c3c-5d7972ecd47e service nova] Creating event network-vif-plugged:6fd3d120-3db3-487b-bcb0-b0f1546bac7d for instance d1d7f247-4a0f-43cb-893b-a937419b4c4c on hv-cinder-83607 May 26 16:41:57.849048 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-0da956b3-f55b-4b8f-8066-18870e48b34e req-08a864d0-e346-4a4a-9c3c-5d7972ecd47e service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058743 May 26 16:41:57.850601 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 81/155] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:41:58.102530 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-dae2432f-4722-4dea-bf84-d3c0c4cdd9ad tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:58.104694 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-e534f69e-adb6-4a43-b13f-f77cf157b32e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:58.107115 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-dae2432f-4722-4dea-bf84-d3c0c4cdd9ad tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:58.107775 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-e534f69e-adb6-4a43-b13f-f77cf157b32e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:58.132552 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dae2432f-4722-4dea-bf84-d3c0c4cdd9ad tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:58.133234 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dae2432f-4722-4dea-bf84-d3c0c4cdd9ad tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:58.133494 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e534f69e-adb6-4a43-b13f-f77cf157b32e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:58.135411 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e534f69e-adb6-4a43-b13f-f77cf157b32e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:58.137967 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e534f69e-adb6-4a43-b13f-f77cf157b32e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:58.138796 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dae2432f-4722-4dea-bf84-d3c0c4cdd9ad tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:58.139700 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e534f69e-adb6-4a43-b13f-f77cf157b32e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:58.143058 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dae2432f-4722-4dea-bf84-d3c0c4cdd9ad tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:58.677221 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-dae2432f-4722-4dea-bf84-d3c0c4cdd9ad tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:58.679349 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-e534f69e-adb6-4a43-b13f-f77cf157b32e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:58.690495 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-dae2432f-4722-4dea-bf84-d3c0c4cdd9ad tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:58.694018 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-dae2432f-4722-4dea-bf84-d3c0c4cdd9ad tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:58.694465 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-e534f69e-adb6-4a43-b13f-f77cf157b32e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1319 microversion: 2.1 time: 0.623493 May 26 16:41:58.704800 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 75/156] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:58 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1319 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:58.713177 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-dae2432f-4722-4dea-bf84-d3c0c4cdd9ad tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1411 microversion: 2.20 time: 0.603136 May 26 16:41:58.715140 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-b45ba300-f190-4200-8d18-02c24db9bb26 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:58.715380 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 82/157] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:41:58 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1411 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:41:58.718925 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-b45ba300-f190-4200-8d18-02c24db9bb26 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:58.739887 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d2245d97-1929-4a39-9712-e0d8013e7872 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:58.744541 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d2245d97-1929-4a39-9712-e0d8013e7872 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:58.754675 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b45ba300-f190-4200-8d18-02c24db9bb26 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:58.755891 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b45ba300-f190-4200-8d18-02c24db9bb26 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:58.759742 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b45ba300-f190-4200-8d18-02c24db9bb26 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:58.762043 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b45ba300-f190-4200-8d18-02c24db9bb26 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:58.777033 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d2245d97-1929-4a39-9712-e0d8013e7872 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:58.777876 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d2245d97-1929-4a39-9712-e0d8013e7872 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:58.779499 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d2245d97-1929-4a39-9712-e0d8013e7872 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:58.780921 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d2245d97-1929-4a39-9712-e0d8013e7872 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:59.272838 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d2245d97-1929-4a39-9712-e0d8013e7872 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:59.290360 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d2245d97-1929-4a39-9712-e0d8013e7872 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1326 microversion: 2.1 time: 0.570497 May 26 16:41:59.294315 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 83/158] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:58 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1326 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:59.434830 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-b45ba300-f190-4200-8d18-02c24db9bb26 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:41:59.453404 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-b45ba300-f190-4200-8d18-02c24db9bb26 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1366 microversion: 2.1 time: 0.755292 May 26 16:41:59.454281 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 76/159] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:58 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1366 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:41:59.716811 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2a579a92-405d-4dc9-9de0-bccbeca095e0 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:59.718040 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2a579a92-405d-4dc9-9de0-bccbeca095e0 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:59.729035 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2a579a92-405d-4dc9-9de0-bccbeca095e0 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:59.730097 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2a579a92-405d-4dc9-9de0-bccbeca095e0 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:59.734979 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2a579a92-405d-4dc9-9de0-bccbeca095e0 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:59.734979 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2a579a92-405d-4dc9-9de0-bccbeca095e0 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:59.736295 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-d21847f4-a283-4e54-8be1-7dcca2ed63dc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:41:59.737200 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-d21847f4-a283-4e54-8be1-7dcca2ed63dc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:41:59.749761 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d21847f4-a283-4e54-8be1-7dcca2ed63dc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:59.750477 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d21847f4-a283-4e54-8be1-7dcca2ed63dc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:41:59.752135 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d21847f4-a283-4e54-8be1-7dcca2ed63dc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:41:59.753725 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d21847f4-a283-4e54-8be1-7dcca2ed63dc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:00.052814 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-2a579a92-405d-4dc9-9de0-bccbeca095e0 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:00.071808 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2a579a92-405d-4dc9-9de0-bccbeca095e0 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1319 microversion: 2.1 time: 0.362154 May 26 16:42:00.073216 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 84/160] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:41:59 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1319 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:00.073550 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-d21847f4-a283-4e54-8be1-7dcca2ed63dc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:00.090008 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-d21847f4-a283-4e54-8be1-7dcca2ed63dc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:00.094875 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-d21847f4-a283-4e54-8be1-7dcca2ed63dc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:00.097960 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-d21847f4-a283-4e54-8be1-7dcca2ed63dc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1411 microversion: 2.20 time: 0.367399 May 26 16:42:00.099044 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 77/161] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:41:59 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1411 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:42:00.328258 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d9d85b3f-0f3b-4fba-a41a-43f83877d56e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:00.329629 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d9d85b3f-0f3b-4fba-a41a-43f83877d56e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:00.341377 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d9d85b3f-0f3b-4fba-a41a-43f83877d56e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:00.342393 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d9d85b3f-0f3b-4fba-a41a-43f83877d56e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:00.344031 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d9d85b3f-0f3b-4fba-a41a-43f83877d56e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:00.345339 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d9d85b3f-0f3b-4fba-a41a-43f83877d56e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:00.483897 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-5f480002-723d-41b8-adb2-03fd3df3a0a1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:00.485243 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-5f480002-723d-41b8-adb2-03fd3df3a0a1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:00.502354 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-5f480002-723d-41b8-adb2-03fd3df3a0a1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:00.503452 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-5f480002-723d-41b8-adb2-03fd3df3a0a1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:00.505272 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-5f480002-723d-41b8-adb2-03fd3df3a0a1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:00.507725 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-5f480002-723d-41b8-adb2-03fd3df3a0a1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:00.540928 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d9d85b3f-0f3b-4fba-a41a-43f83877d56e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:00.557203 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d9d85b3f-0f3b-4fba-a41a-43f83877d56e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1326 microversion: 2.1 time: 0.238769 May 26 16:42:00.558450 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 85/162] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:00 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1326 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:00.833450 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-5f480002-723d-41b8-adb2-03fd3df3a0a1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:00.848908 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-5f480002-723d-41b8-adb2-03fd3df3a0a1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1366 microversion: 2.1 time: 0.372675 May 26 16:42:00.850615 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 78/163] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:00 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1366 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:01.098288 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-14a2a3c2-6b7c-44ed-b630-1b46d958c6bd tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:01.099550 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-14a2a3c2-6b7c-44ed-b630-1b46d958c6bd tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:01.111393 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-14a2a3c2-6b7c-44ed-b630-1b46d958c6bd tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:01.112013 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-14a2a3c2-6b7c-44ed-b630-1b46d958c6bd tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:01.113612 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-14a2a3c2-6b7c-44ed-b630-1b46d958c6bd tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:01.114465 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-14a2a3c2-6b7c-44ed-b630-1b46d958c6bd tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:01.133411 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-387eeb05-c19d-4e25-9415-fc0905e7b91f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:01.135211 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-387eeb05-c19d-4e25-9415-fc0905e7b91f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:01.148137 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-387eeb05-c19d-4e25-9415-fc0905e7b91f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:01.149511 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-387eeb05-c19d-4e25-9415-fc0905e7b91f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:01.151597 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-387eeb05-c19d-4e25-9415-fc0905e7b91f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:01.152727 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-387eeb05-c19d-4e25-9415-fc0905e7b91f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:01.517194 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-14a2a3c2-6b7c-44ed-b630-1b46d958c6bd tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:01.526795 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-387eeb05-c19d-4e25-9415-fc0905e7b91f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:01.533410 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-14a2a3c2-6b7c-44ed-b630-1b46d958c6bd tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1319 microversion: 2.1 time: 0.441567 May 26 16:42:01.535376 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 86/164] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:01 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1319 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:01.545732 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-387eeb05-c19d-4e25-9415-fc0905e7b91f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:01.548772 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-387eeb05-c19d-4e25-9415-fc0905e7b91f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:01.551323 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-387eeb05-c19d-4e25-9415-fc0905e7b91f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1411 microversion: 2.20 time: 0.424480 May 26 16:42:01.552564 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 79/165] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:42:01 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1411 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:42:01.580925 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-5969ca96-96be-45fd-84c9-8062c3571baa tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:01.581981 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-5969ca96-96be-45fd-84c9-8062c3571baa tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:01.588791 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=88 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:01.601975 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5969ca96-96be-45fd-84c9-8062c3571baa tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:01.604708 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5969ca96-96be-45fd-84c9-8062c3571baa tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:01.606485 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5969ca96-96be-45fd-84c9-8062c3571baa tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:01.607294 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5969ca96-96be-45fd-84c9-8062c3571baa tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:01.864719 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-5969ca96-96be-45fd-84c9-8062c3571baa tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:01.876676 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-f020959e-6409-4bea-ac2a-24dbdb3bc3bc tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:01.877782 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-f020959e-6409-4bea-ac2a-24dbdb3bc3bc tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:01.889375 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:01.891692 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f020959e-6409-4bea-ac2a-24dbdb3bc3bc tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:01.892891 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-5969ca96-96be-45fd-84c9-8062c3571baa tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1326 microversion: 2.1 time: 0.319732 May 26 16:42:01.902752 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 87/166] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:01 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1326 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:01.903571 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f020959e-6409-4bea-ac2a-24dbdb3bc3bc tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:01.904734 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f020959e-6409-4bea-ac2a-24dbdb3bc3bc tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:01.905293 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f020959e-6409-4bea-ac2a-24dbdb3bc3bc tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:02.238483 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-f020959e-6409-4bea-ac2a-24dbdb3bc3bc tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:02.248606 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-f020959e-6409-4bea-ac2a-24dbdb3bc3bc tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1366 microversion: 2.1 time: 0.375831 May 26 16:42:02.249655 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 80/167] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:01 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1366 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:42:02.562031 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ef841b77-4731-4f78-85f8-76d2d6aa4646 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:02.563003 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ef841b77-4731-4f78-85f8-76d2d6aa4646 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:02.572412 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ef841b77-4731-4f78-85f8-76d2d6aa4646 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:02.573165 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ef841b77-4731-4f78-85f8-76d2d6aa4646 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:02.574156 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ef841b77-4731-4f78-85f8-76d2d6aa4646 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:02.574685 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ef841b77-4731-4f78-85f8-76d2d6aa4646 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:02.591648 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-b094005e-df41-48af-a2cc-15745b813d3f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:02.593248 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-b094005e-df41-48af-a2cc-15745b813d3f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:02.608840 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b094005e-df41-48af-a2cc-15745b813d3f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:02.611258 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b094005e-df41-48af-a2cc-15745b813d3f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:02.612693 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b094005e-df41-48af-a2cc-15745b813d3f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:02.613811 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b094005e-df41-48af-a2cc-15745b813d3f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:02.847860 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ef841b77-4731-4f78-85f8-76d2d6aa4646 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:02.871167 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ef841b77-4731-4f78-85f8-76d2d6aa4646 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1319 microversion: 2.1 time: 0.314836 May 26 16:42:02.884947 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 88/168] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:02 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1319 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:02.927585 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-91f11c00-673d-4d4b-8e06-9e533e1878f1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:02.928667 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-91f11c00-673d-4d4b-8e06-9e533e1878f1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:02.942053 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-b094005e-df41-48af-a2cc-15745b813d3f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:02.946746 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-91f11c00-673d-4d4b-8e06-9e533e1878f1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:02.947623 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-91f11c00-673d-4d4b-8e06-9e533e1878f1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:02.949291 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-91f11c00-673d-4d4b-8e06-9e533e1878f1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:02.950020 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-91f11c00-673d-4d4b-8e06-9e533e1878f1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:02.953449 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-b094005e-df41-48af-a2cc-15745b813d3f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:02.955938 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-b094005e-df41-48af-a2cc-15745b813d3f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:02.959074 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-b094005e-df41-48af-a2cc-15745b813d3f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1411 microversion: 2.20 time: 0.381251 May 26 16:42:02.959970 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 81/169] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:42:02 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1411 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:42:03.165193 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-91f11c00-673d-4d4b-8e06-9e533e1878f1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:03.175289 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-91f11c00-673d-4d4b-8e06-9e533e1878f1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1326 microversion: 2.1 time: 0.265308 May 26 16:42:03.176586 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 89/170] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:02 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1326 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:03.280074 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-9eeeaa29-93ca-42e9-b1f9-92a1f408d8ab tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:03.281152 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-9eeeaa29-93ca-42e9-b1f9-92a1f408d8ab tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:03.296854 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9eeeaa29-93ca-42e9-b1f9-92a1f408d8ab tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:03.298197 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9eeeaa29-93ca-42e9-b1f9-92a1f408d8ab tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:03.299340 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9eeeaa29-93ca-42e9-b1f9-92a1f408d8ab tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:03.300068 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9eeeaa29-93ca-42e9-b1f9-92a1f408d8ab tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:03.530350 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-9eeeaa29-93ca-42e9-b1f9-92a1f408d8ab tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:03.547696 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-9eeeaa29-93ca-42e9-b1f9-92a1f408d8ab tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1366 microversion: 2.1 time: 0.276122 May 26 16:42:03.548301 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 82/171] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:03 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:03.895001 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f5416a5f-6881-4278-922d-eb0d3b9fe8e0 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:03.896241 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f5416a5f-6881-4278-922d-eb0d3b9fe8e0 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:03.904465 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f5416a5f-6881-4278-922d-eb0d3b9fe8e0 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:03.904465 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f5416a5f-6881-4278-922d-eb0d3b9fe8e0 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:03.906090 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f5416a5f-6881-4278-922d-eb0d3b9fe8e0 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:03.906870 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f5416a5f-6881-4278-922d-eb0d3b9fe8e0 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:03.979450 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-1daa1508-0ce7-43cd-9741-1eed9b0569ce tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:03.980778 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-1daa1508-0ce7-43cd-9741-1eed9b0569ce tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:03.987793 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1daa1508-0ce7-43cd-9741-1eed9b0569ce tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:03.988248 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1daa1508-0ce7-43cd-9741-1eed9b0569ce tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:03.989087 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1daa1508-0ce7-43cd-9741-1eed9b0569ce tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:03.989725 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1daa1508-0ce7-43cd-9741-1eed9b0569ce tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:04.115596 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f5416a5f-6881-4278-922d-eb0d3b9fe8e0 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:04.133336 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f5416a5f-6881-4278-922d-eb0d3b9fe8e0 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1319 microversion: 2.1 time: 0.242007 May 26 16:42:04.134767 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 90/172] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:03 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:04.177765 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-1daa1508-0ce7-43cd-9741-1eed9b0569ce tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:04.186685 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-1daa1508-0ce7-43cd-9741-1eed9b0569ce tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:04.188217 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-1daa1508-0ce7-43cd-9741-1eed9b0569ce tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:04.189612 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-1daa1508-0ce7-43cd-9741-1eed9b0569ce tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1411 microversion: 2.20 time: 0.215592 May 26 16:42:04.190197 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 83/173] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:42:03 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1411 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:42:04.202629 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3aeccc30-c6a1-48e0-bbdf-1320c5c4658a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:04.203437 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-3aeccc30-c6a1-48e0-bbdf-1320c5c4658a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:04.214123 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3aeccc30-c6a1-48e0-bbdf-1320c5c4658a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:04.214814 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3aeccc30-c6a1-48e0-bbdf-1320c5c4658a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:04.216301 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3aeccc30-c6a1-48e0-bbdf-1320c5c4658a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:04.217215 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3aeccc30-c6a1-48e0-bbdf-1320c5c4658a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:04.434908 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3aeccc30-c6a1-48e0-bbdf-1320c5c4658a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:04.444575 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-3aeccc30-c6a1-48e0-bbdf-1320c5c4658a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1326 microversion: 2.1 time: 0.247972 May 26 16:42:04.445167 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 91/174] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:04 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1326 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:04.573431 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-59c9b089-d388-4b23-9c4f-216db85198cb tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:04.574350 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-59c9b089-d388-4b23-9c4f-216db85198cb tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:04.584634 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-59c9b089-d388-4b23-9c4f-216db85198cb tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:04.585710 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-59c9b089-d388-4b23-9c4f-216db85198cb tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:04.587457 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-59c9b089-d388-4b23-9c4f-216db85198cb tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:04.588037 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-59c9b089-d388-4b23-9c4f-216db85198cb tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:04.790761 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-59c9b089-d388-4b23-9c4f-216db85198cb tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:04.800695 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-59c9b089-d388-4b23-9c4f-216db85198cb tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1366 microversion: 2.1 time: 0.232614 May 26 16:42:04.801682 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 84/175] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:04 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:05.155886 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-027103c9-6bd0-41a1-a99c-35ac0024b1ca tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:05.156951 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-027103c9-6bd0-41a1-a99c-35ac0024b1ca tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:05.163188 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-027103c9-6bd0-41a1-a99c-35ac0024b1ca tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:05.163639 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-027103c9-6bd0-41a1-a99c-35ac0024b1ca tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:05.164459 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-027103c9-6bd0-41a1-a99c-35ac0024b1ca tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:05.165406 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-027103c9-6bd0-41a1-a99c-35ac0024b1ca tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:05.211448 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-4216daa6-6ad3-4177-8ac7-65128f374184 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:05.213115 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-4216daa6-6ad3-4177-8ac7-65128f374184 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:05.221551 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4216daa6-6ad3-4177-8ac7-65128f374184 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:05.221965 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4216daa6-6ad3-4177-8ac7-65128f374184 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:05.223237 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4216daa6-6ad3-4177-8ac7-65128f374184 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:05.223724 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4216daa6-6ad3-4177-8ac7-65128f374184 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:05.419594 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-027103c9-6bd0-41a1-a99c-35ac0024b1ca tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:05.439955 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-027103c9-6bd0-41a1-a99c-35ac0024b1ca tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1319 microversion: 2.1 time: 0.286532 May 26 16:42:05.441072 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 92/176] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:05 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:42:05.455645 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-4216daa6-6ad3-4177-8ac7-65128f374184 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:05.464362 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-dd332712-1566-4b32-915e-cb77a86f8bfb tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:05.465012 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-dd332712-1566-4b32-915e-cb77a86f8bfb tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:05.472508 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-4216daa6-6ad3-4177-8ac7-65128f374184 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:05.475651 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-4216daa6-6ad3-4177-8ac7-65128f374184 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:05.478498 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-4216daa6-6ad3-4177-8ac7-65128f374184 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1411 microversion: 2.20 time: 0.270318 May 26 16:42:05.479893 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 85/177] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:42:05 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1411 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:42:05.486855 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dd332712-1566-4b32-915e-cb77a86f8bfb tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:05.487631 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dd332712-1566-4b32-915e-cb77a86f8bfb tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:05.491690 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dd332712-1566-4b32-915e-cb77a86f8bfb tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:05.492525 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dd332712-1566-4b32-915e-cb77a86f8bfb tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:05.700887 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-dd332712-1566-4b32-915e-cb77a86f8bfb tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:05.713382 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-dd332712-1566-4b32-915e-cb77a86f8bfb tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1326 microversion: 2.1 time: 0.253189 May 26 16:42:05.714289 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 93/178] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:05 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1326 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:05.822911 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-749fe3bc-d9a4-4a4a-aa1f-3f3d1b8c6d1a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:05.823518 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-749fe3bc-d9a4-4a4a-aa1f-3f3d1b8c6d1a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:05.830377 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-749fe3bc-d9a4-4a4a-aa1f-3f3d1b8c6d1a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:05.830827 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-749fe3bc-d9a4-4a4a-aa1f-3f3d1b8c6d1a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:05.831616 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-749fe3bc-d9a4-4a4a-aa1f-3f3d1b8c6d1a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:05.832063 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-749fe3bc-d9a4-4a4a-aa1f-3f3d1b8c6d1a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:06.023011 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-749fe3bc-d9a4-4a4a-aa1f-3f3d1b8c6d1a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:06.035284 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-749fe3bc-d9a4-4a4a-aa1f-3f3d1b8c6d1a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1366 microversion: 2.1 time: 0.216583 May 26 16:42:06.036303 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 86/179] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:05 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:06.469068 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-89d128be-10d4-417c-afff-c6e653559f37 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:06.469907 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-89d128be-10d4-417c-afff-c6e653559f37 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:06.480189 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-89d128be-10d4-417c-afff-c6e653559f37 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:06.481029 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-89d128be-10d4-417c-afff-c6e653559f37 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:06.482503 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-89d128be-10d4-417c-afff-c6e653559f37 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:06.483311 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-89d128be-10d4-417c-afff-c6e653559f37 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:06.501295 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-d9628b35-03f5-4e27-bc6b-f20195d18f25 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:06.502352 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-d9628b35-03f5-4e27-bc6b-f20195d18f25 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:06.512645 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d9628b35-03f5-4e27-bc6b-f20195d18f25 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:06.515318 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d9628b35-03f5-4e27-bc6b-f20195d18f25 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:06.517176 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d9628b35-03f5-4e27-bc6b-f20195d18f25 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:06.518423 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d9628b35-03f5-4e27-bc6b-f20195d18f25 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:06.801934 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-89d128be-10d4-417c-afff-c6e653559f37 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:06.812270 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-89d128be-10d4-417c-afff-c6e653559f37 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1319 microversion: 2.1 time: 0.347198 May 26 16:42:06.814279 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 94/180] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:06 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1319 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:42:06.820979 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0f2e5176-ef4b-4049-9825-99153aee2af3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:06.822159 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0f2e5176-ef4b-4049-9825-99153aee2af3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:06.835634 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-d9628b35-03f5-4e27-bc6b-f20195d18f25 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:06.837035 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0f2e5176-ef4b-4049-9825-99153aee2af3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:06.838138 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0f2e5176-ef4b-4049-9825-99153aee2af3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:06.840762 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0f2e5176-ef4b-4049-9825-99153aee2af3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:06.841836 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0f2e5176-ef4b-4049-9825-99153aee2af3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:06.875348 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-d9628b35-03f5-4e27-bc6b-f20195d18f25 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:06.885713 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-d9628b35-03f5-4e27-bc6b-f20195d18f25 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:06.890669 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-d9628b35-03f5-4e27-bc6b-f20195d18f25 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1411 microversion: 2.20 time: 0.394596 May 26 16:42:06.892924 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 87/181] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:42:06 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1411 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:42:07.062678 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-18309881-eb8b-4eea-8c64-8811dbb06e3b tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:07.064412 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-18309881-eb8b-4eea-8c64-8811dbb06e3b tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:07.076515 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-18309881-eb8b-4eea-8c64-8811dbb06e3b tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:07.077755 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-18309881-eb8b-4eea-8c64-8811dbb06e3b tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:07.079286 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-18309881-eb8b-4eea-8c64-8811dbb06e3b tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:07.080361 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-18309881-eb8b-4eea-8c64-8811dbb06e3b tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:07.290357 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0f2e5176-ef4b-4049-9825-99153aee2af3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:07.306830 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0f2e5176-ef4b-4049-9825-99153aee2af3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1326 microversion: 2.1 time: 0.489623 May 26 16:42:07.309391 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 95/182] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:06 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1326 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:07.363066 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-18309881-eb8b-4eea-8c64-8811dbb06e3b tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:07.373278 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-18309881-eb8b-4eea-8c64-8811dbb06e3b tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1366 microversion: 2.1 time: 0.318583 May 26 16:42:07.373922 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 88/183] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:07 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1366 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:07.841200 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-bdbfec57-522c-4c63-a7a4-f91c4941cc66 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:07.842205 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-bdbfec57-522c-4c63-a7a4-f91c4941cc66 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:07.849192 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bdbfec57-522c-4c63-a7a4-f91c4941cc66 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:07.849651 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bdbfec57-522c-4c63-a7a4-f91c4941cc66 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:07.850450 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bdbfec57-522c-4c63-a7a4-f91c4941cc66 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:07.850894 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bdbfec57-522c-4c63-a7a4-f91c4941cc66 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:07.868022 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=100 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:07.917227 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-fa812237-bf66-43d3-9dcd-e9608c00c01d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:07.918530 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-fa812237-bf66-43d3-9dcd-e9608c00c01d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:07.925583 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fa812237-bf66-43d3-9dcd-e9608c00c01d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:07.926121 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fa812237-bf66-43d3-9dcd-e9608c00c01d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:07.926938 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fa812237-bf66-43d3-9dcd-e9608c00c01d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:07.927433 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fa812237-bf66-43d3-9dcd-e9608c00c01d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:08.137635 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-bdbfec57-522c-4c63-a7a4-f91c4941cc66 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:08.148685 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-bdbfec57-522c-4c63-a7a4-f91c4941cc66 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1319 microversion: 2.1 time: 0.312779 May 26 16:42:08.149773 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 96/184] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:07 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1319 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:42:08.227809 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-fa812237-bf66-43d3-9dcd-e9608c00c01d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:08.245697 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-fa812237-bf66-43d3-9dcd-e9608c00c01d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:08.248778 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-fa812237-bf66-43d3-9dcd-e9608c00c01d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:08.250777 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-fa812237-bf66-43d3-9dcd-e9608c00c01d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1411 microversion: 2.20 time: 0.337952 May 26 16:42:08.251749 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 89/185] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:42:07 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1411 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:42:08.337294 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-22d7a53b-3e19-43dc-98d3-98917812a759 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:08.338241 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-22d7a53b-3e19-43dc-98d3-98917812a759 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:08.348362 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-22d7a53b-3e19-43dc-98d3-98917812a759 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:08.349579 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-22d7a53b-3e19-43dc-98d3-98917812a759 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:08.350783 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-22d7a53b-3e19-43dc-98d3-98917812a759 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:08.351523 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-22d7a53b-3e19-43dc-98d3-98917812a759 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:08.394787 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-e8b300f1-a1de-43ce-97c2-087d830658d9 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:08.396481 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-e8b300f1-a1de-43ce-97c2-087d830658d9 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:08.407633 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e8b300f1-a1de-43ce-97c2-087d830658d9 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:08.408446 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e8b300f1-a1de-43ce-97c2-087d830658d9 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:08.409870 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e8b300f1-a1de-43ce-97c2-087d830658d9 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:08.410669 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e8b300f1-a1de-43ce-97c2-087d830658d9 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:08.625619 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-22d7a53b-3e19-43dc-98d3-98917812a759 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:08.641316 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-22d7a53b-3e19-43dc-98d3-98917812a759 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1326 microversion: 2.1 time: 0.310253 May 26 16:42:08.642776 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 97/186] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:08 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1326 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:08.660007 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-e8b300f1-a1de-43ce-97c2-087d830658d9 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:08.663745 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=100 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:08.674648 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-e8b300f1-a1de-43ce-97c2-087d830658d9 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1366 microversion: 2.1 time: 0.286305 May 26 16:42:08.675675 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 90/187] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:08 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:42:09.177309 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-23c30447-ab27-4762-af9b-fd5c1b170b1e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:09.178626 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-23c30447-ab27-4762-af9b-fd5c1b170b1e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:09.191105 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-23c30447-ab27-4762-af9b-fd5c1b170b1e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:09.192635 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-23c30447-ab27-4762-af9b-fd5c1b170b1e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:09.194536 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-23c30447-ab27-4762-af9b-fd5c1b170b1e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:09.195609 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-23c30447-ab27-4762-af9b-fd5c1b170b1e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:09.275411 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-86148602-295f-47f9-9d7f-ba8242f360ac tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:09.276406 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-86148602-295f-47f9-9d7f-ba8242f360ac tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:09.287395 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-86148602-295f-47f9-9d7f-ba8242f360ac tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:09.288505 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-86148602-295f-47f9-9d7f-ba8242f360ac tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:09.291362 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-86148602-295f-47f9-9d7f-ba8242f360ac tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:09.292455 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-86148602-295f-47f9-9d7f-ba8242f360ac tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:09.508588 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-23c30447-ab27-4762-af9b-fd5c1b170b1e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:09.523695 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-23c30447-ab27-4762-af9b-fd5c1b170b1e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1319 microversion: 2.1 time: 0.358559 May 26 16:42:09.525607 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 98/188] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:09 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1319 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:09.545706 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-86148602-295f-47f9-9d7f-ba8242f360ac tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:09.554827 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-86148602-295f-47f9-9d7f-ba8242f360ac tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:09.556830 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-86148602-295f-47f9-9d7f-ba8242f360ac tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:09.558184 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-86148602-295f-47f9-9d7f-ba8242f360ac tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1411 microversion: 2.20 time: 0.288799 May 26 16:42:09.558890 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 91/189] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:42:09 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1411 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:42:09.663144 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-c7018d7e-0eee-419f-baf3-b6e5237aa34c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:09.664236 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-c7018d7e-0eee-419f-baf3-b6e5237aa34c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:09.674421 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c7018d7e-0eee-419f-baf3-b6e5237aa34c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:09.675172 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c7018d7e-0eee-419f-baf3-b6e5237aa34c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:09.676423 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c7018d7e-0eee-419f-baf3-b6e5237aa34c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:09.677141 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c7018d7e-0eee-419f-baf3-b6e5237aa34c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:09.695745 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-39233000-1354-46ff-8776-c163cbe631f2 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:09.697517 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-39233000-1354-46ff-8776-c163cbe631f2 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:09.704564 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-39233000-1354-46ff-8776-c163cbe631f2 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:09.704922 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-39233000-1354-46ff-8776-c163cbe631f2 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:09.705928 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-39233000-1354-46ff-8776-c163cbe631f2 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:09.706553 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-39233000-1354-46ff-8776-c163cbe631f2 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:10.018577 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-39233000-1354-46ff-8776-c163cbe631f2 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:10.030247 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-39233000-1354-46ff-8776-c163cbe631f2 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1366 microversion: 2.1 time: 0.338737 May 26 16:42:10.040616 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 92/190] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:09 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1366 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:42:10.084569 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c7018d7e-0eee-419f-baf3-b6e5237aa34c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:10.097074 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-c7018d7e-0eee-419f-baf3-b6e5237aa34c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1326 microversion: 2.1 time: 0.439803 May 26 16:42:10.098202 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 99/191] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:09 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1326 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:10.544544 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-b1faf8b0-3e7e-4e87-b0eb-2fdc9c603334 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:10.545422 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-b1faf8b0-3e7e-4e87-b0eb-2fdc9c603334 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:10.553062 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b1faf8b0-3e7e-4e87-b0eb-2fdc9c603334 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:10.553604 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b1faf8b0-3e7e-4e87-b0eb-2fdc9c603334 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:10.554647 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b1faf8b0-3e7e-4e87-b0eb-2fdc9c603334 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:10.555146 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b1faf8b0-3e7e-4e87-b0eb-2fdc9c603334 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:10.580519 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-b41eafa5-192b-49df-a8a5-9b5209f407fc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:10.581446 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-b41eafa5-192b-49df-a8a5-9b5209f407fc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:10.589757 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b41eafa5-192b-49df-a8a5-9b5209f407fc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:10.590304 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b41eafa5-192b-49df-a8a5-9b5209f407fc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:10.591172 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b41eafa5-192b-49df-a8a5-9b5209f407fc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:10.591709 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b41eafa5-192b-49df-a8a5-9b5209f407fc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:10.843138 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-b1faf8b0-3e7e-4e87-b0eb-2fdc9c603334 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:10.856590 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-b1faf8b0-3e7e-4e87-b0eb-2fdc9c603334 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1319 microversion: 2.1 time: 0.317041 May 26 16:42:10.859981 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 93/192] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:10 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1319 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:10.861389 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b41eafa5-192b-49df-a8a5-9b5209f407fc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:10.876533 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b41eafa5-192b-49df-a8a5-9b5209f407fc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:10.880130 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b41eafa5-192b-49df-a8a5-9b5209f407fc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:10.882408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-b41eafa5-192b-49df-a8a5-9b5209f407fc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1411 microversion: 2.20 time: 0.307918 May 26 16:42:10.883814 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 100/193] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:42:10 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1411 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:42:11.049989 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-0e03c690-b441-4024-befd-244603cf2834 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:11.050882 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-0e03c690-b441-4024-befd-244603cf2834 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:11.060030 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0e03c690-b441-4024-befd-244603cf2834 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:11.060747 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0e03c690-b441-4024-befd-244603cf2834 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:11.061946 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0e03c690-b441-4024-befd-244603cf2834 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:11.062606 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0e03c690-b441-4024-befd-244603cf2834 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:11.123070 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a86b6095-7c5a-48e2-b011-64d8ed85537a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:11.124294 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a86b6095-7c5a-48e2-b011-64d8ed85537a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:11.135574 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a86b6095-7c5a-48e2-b011-64d8ed85537a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:11.136507 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a86b6095-7c5a-48e2-b011-64d8ed85537a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:11.138006 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a86b6095-7c5a-48e2-b011-64d8ed85537a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:11.138844 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a86b6095-7c5a-48e2-b011-64d8ed85537a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:11.333171 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-0e03c690-b441-4024-befd-244603cf2834 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:11.347342 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-0e03c690-b441-4024-befd-244603cf2834 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1366 microversion: 2.1 time: 0.303001 May 26 16:42:11.348414 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 94/194] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:11 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1366 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:42:11.371171 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a86b6095-7c5a-48e2-b011-64d8ed85537a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:11.383188 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a86b6095-7c5a-48e2-b011-64d8ed85537a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1326 microversion: 2.1 time: 0.265829 May 26 16:42:11.384266 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 101/195] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:11 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1326 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:42:11.885425 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-8ac7663c-784e-4a9e-9a02-99ab662340cd tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:11.886463 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-8ac7663c-784e-4a9e-9a02-99ab662340cd tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:11.896804 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8ac7663c-784e-4a9e-9a02-99ab662340cd tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:11.897541 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8ac7663c-784e-4a9e-9a02-99ab662340cd tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:11.900322 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8ac7663c-784e-4a9e-9a02-99ab662340cd tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:11.901066 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8ac7663c-784e-4a9e-9a02-99ab662340cd tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:11.903166 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e4658ec6-ba2f-4ba2-97bb-fbfcbd355e25 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:11.904003 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e4658ec6-ba2f-4ba2-97bb-fbfcbd355e25 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:11.915692 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e4658ec6-ba2f-4ba2-97bb-fbfcbd355e25 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:11.916649 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e4658ec6-ba2f-4ba2-97bb-fbfcbd355e25 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:11.918102 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e4658ec6-ba2f-4ba2-97bb-fbfcbd355e25 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:11.918889 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e4658ec6-ba2f-4ba2-97bb-fbfcbd355e25 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:12.160527 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-8ac7663c-784e-4a9e-9a02-99ab662340cd tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:12.167697 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e4658ec6-ba2f-4ba2-97bb-fbfcbd355e25 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:12.174958 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-8ac7663c-784e-4a9e-9a02-99ab662340cd tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1505 microversion: 2.1 time: 0.296368 May 26 16:42:12.176182 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 95/196] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:11 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1505 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:12.185191 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e4658ec6-ba2f-4ba2-97bb-fbfcbd355e25 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:12.187877 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e4658ec6-ba2f-4ba2-97bb-fbfcbd355e25 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:12.189598 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e4658ec6-ba2f-4ba2-97bb-fbfcbd355e25 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1411 microversion: 2.20 time: 0.291269 May 26 16:42:12.190725 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 102/197] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:42:11 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1411 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:42:12.367495 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-7b3d74f8-40ea-47ef-b3f0-317dd24cface tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:12.369158 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-7b3d74f8-40ea-47ef-b3f0-317dd24cface tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:12.379477 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7b3d74f8-40ea-47ef-b3f0-317dd24cface tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:12.380325 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7b3d74f8-40ea-47ef-b3f0-317dd24cface tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:12.381854 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7b3d74f8-40ea-47ef-b3f0-317dd24cface tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:12.382644 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7b3d74f8-40ea-47ef-b3f0-317dd24cface tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:12.413513 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-94473abd-8565-48a1-91a6-7305b06ef908 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:12.415834 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-94473abd-8565-48a1-91a6-7305b06ef908 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:12.438851 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-94473abd-8565-48a1-91a6-7305b06ef908 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:12.441218 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-94473abd-8565-48a1-91a6-7305b06ef908 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:12.444877 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-94473abd-8565-48a1-91a6-7305b06ef908 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:12.446629 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-94473abd-8565-48a1-91a6-7305b06ef908 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:13.190054 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-7b3d74f8-40ea-47ef-b3f0-317dd24cface tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:13.199240 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-7b3d74f8-40ea-47ef-b3f0-317dd24cface tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1366 microversion: 2.1 time: 0.836327 May 26 16:42:13.210325 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 96/198] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:12 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1366 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:13.218412 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-40dc277e-07ac-4680-ae98-1d4c766bc7a4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:13.219528 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-40dc277e-07ac-4680-ae98-1d4c766bc7a4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:13.231255 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-40dc277e-07ac-4680-ae98-1d4c766bc7a4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:13.232336 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-40dc277e-07ac-4680-ae98-1d4c766bc7a4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:13.234994 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-40dc277e-07ac-4680-ae98-1d4c766bc7a4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:13.236016 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-40dc277e-07ac-4680-ae98-1d4c766bc7a4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:13.275175 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-94473abd-8565-48a1-91a6-7305b06ef908 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:13.292765 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-94473abd-8565-48a1-91a6-7305b06ef908 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1326 microversion: 2.1 time: 0.891289 May 26 16:42:13.296776 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 103/199] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:12 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1326 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:13.474977 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-40dc277e-07ac-4680-ae98-1d4c766bc7a4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:13.489792 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-40dc277e-07ac-4680-ae98-1d4c766bc7a4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:13.491901 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-40dc277e-07ac-4680-ae98-1d4c766bc7a4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:13.493976 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-40dc277e-07ac-4680-ae98-1d4c766bc7a4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1411 microversion: 2.20 time: 0.281980 May 26 16:42:13.494875 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 97/200] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:42:13 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1411 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:42:14.123478 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6c8e5ef8-cc96-4162-a510-8b6829445d7e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d9abe42-be68-4d18-9136-40f8470d0089"}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:42:14.127220 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-6c8e5ef8-cc96-4162-a510-8b6829445d7e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:14.139363 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6c8e5ef8-cc96-4162-a510-8b6829445d7e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:14.140163 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6c8e5ef8-cc96-4162-a510-8b6829445d7e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:14.141679 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6c8e5ef8-cc96-4162-a510-8b6829445d7e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:14.142486 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6c8e5ef8-cc96-4162-a510-8b6829445d7e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:14.234166 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-6f49140e-4f33-4e54-a068-cb7ef61e54c7 req-6a2ce449-0620-48ee-a7fe-4c9b567c0fff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a636d450-9d10-45a5-9982-9e10393fc4a9", "name": "network-vif-plugged", "status": "completed", "tag": "444eb6a1-a511-4e39-a006-252d0ba39886"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:42:14.253984 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-6f49140e-4f33-4e54-a068-cb7ef61e54c7 req-6a2ce449-0620-48ee-a7fe-4c9b567c0fff service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:14.257702 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-6f49140e-4f33-4e54-a068-cb7ef61e54c7 req-6a2ce449-0620-48ee-a7fe-4c9b567c0fff service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:14.497732 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-6f49140e-4f33-4e54-a068-cb7ef61e54c7 req-6a2ce449-0620-48ee-a7fe-4c9b567c0fff service nova] Creating event network-vif-plugged:444eb6a1-a511-4e39-a006-252d0ba39886 for instance a636d450-9d10-45a5-9982-9e10393fc4a9 on hv-cinder-83607 May 26 16:42:14.503647 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-6f49140e-4f33-4e54-a068-cb7ef61e54c7 req-6a2ce449-0620-48ee-a7fe-4c9b567c0fff service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.295943 May 26 16:42:14.504318 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 98/201] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:42:14.511648 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-de77e498-e77f-454c-bb56-351a63f57605 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:14.512430 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-de77e498-e77f-454c-bb56-351a63f57605 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:14.526656 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-de77e498-e77f-454c-bb56-351a63f57605 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:14.527504 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-de77e498-e77f-454c-bb56-351a63f57605 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:14.529022 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-de77e498-e77f-454c-bb56-351a63f57605 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:14.530813 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-de77e498-e77f-454c-bb56-351a63f57605 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:14.804021 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-de77e498-e77f-454c-bb56-351a63f57605 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:14.817259 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-de77e498-e77f-454c-bb56-351a63f57605 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1366 microversion: 2.1 time: 0.311273 May 26 16:42:14.818215 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 99/202] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:14 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1366 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:14.824218 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-f225c9d2-9e7d-40dc-8cc1-9e84dc54901a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:14.825219 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-f225c9d2-9e7d-40dc-8cc1-9e84dc54901a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:14.832785 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f225c9d2-9e7d-40dc-8cc1-9e84dc54901a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:14.833655 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f225c9d2-9e7d-40dc-8cc1-9e84dc54901a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:14.834704 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f225c9d2-9e7d-40dc-8cc1-9e84dc54901a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:14.835387 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f225c9d2-9e7d-40dc-8cc1-9e84dc54901a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:15.197073 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-f225c9d2-9e7d-40dc-8cc1-9e84dc54901a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:15.214387 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-f225c9d2-9e7d-40dc-8cc1-9e84dc54901a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1326 microversion: 2.1 time: 0.394526 May 26 16:42:15.215880 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 100/203] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:14 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1326 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:15.226288 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-a2d42c3f-45cd-4422-8b57-f66d0114413b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:15.227456 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-a2d42c3f-45cd-4422-8b57-f66d0114413b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:15.238860 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a2d42c3f-45cd-4422-8b57-f66d0114413b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:15.240783 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a2d42c3f-45cd-4422-8b57-f66d0114413b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:15.242628 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a2d42c3f-45cd-4422-8b57-f66d0114413b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:15.244064 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a2d42c3f-45cd-4422-8b57-f66d0114413b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:15.522651 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-a2d42c3f-45cd-4422-8b57-f66d0114413b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:15.548956 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-a2d42c3f-45cd-4422-8b57-f66d0114413b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:15.557120 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-a2d42c3f-45cd-4422-8b57-f66d0114413b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:15.559706 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-a2d42c3f-45cd-4422-8b57-f66d0114413b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1411 microversion: 2.20 time: 0.341503 May 26 16:42:15.560865 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 101/204] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:42:15 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1411 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:42:15.848936 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-229bc73d-680b-46da-a1fb-2c19356fa242 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:15.850072 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-229bc73d-680b-46da-a1fb-2c19356fa242 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:15.861629 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-229bc73d-680b-46da-a1fb-2c19356fa242 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:15.862423 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-229bc73d-680b-46da-a1fb-2c19356fa242 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:15.863824 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-229bc73d-680b-46da-a1fb-2c19356fa242 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:15.864632 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-229bc73d-680b-46da-a1fb-2c19356fa242 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:16.114897 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-229bc73d-680b-46da-a1fb-2c19356fa242 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:16.127598 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-229bc73d-680b-46da-a1fb-2c19356fa242 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1366 microversion: 2.1 time: 0.285360 May 26 16:42:16.128520 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 102/205] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:15 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:16.234923 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-287e52cb-5341-4e87-a848-2bfa66234e60 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:16.236196 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-287e52cb-5341-4e87-a848-2bfa66234e60 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:16.252150 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-287e52cb-5341-4e87-a848-2bfa66234e60 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:16.259900 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-287e52cb-5341-4e87-a848-2bfa66234e60 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:16.262010 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-287e52cb-5341-4e87-a848-2bfa66234e60 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:16.266081 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-287e52cb-5341-4e87-a848-2bfa66234e60 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:16.635106 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-287e52cb-5341-4e87-a848-2bfa66234e60 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:16.655773 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-287e52cb-5341-4e87-a848-2bfa66234e60 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1326 microversion: 2.1 time: 0.425628 May 26 16:42:16.658495 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 103/206] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:16 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1326 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:16.670379 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-dcb42915-0b36-4f2d-9291-c1652907f639 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:16.672948 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-dcb42915-0b36-4f2d-9291-c1652907f639 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:16.689277 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-dcb42915-0b36-4f2d-9291-c1652907f639 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:16.690471 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-dcb42915-0b36-4f2d-9291-c1652907f639 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:16.692751 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-dcb42915-0b36-4f2d-9291-c1652907f639 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:16.695644 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-dcb42915-0b36-4f2d-9291-c1652907f639 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:16.858577 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6c8e5ef8-cc96-4162-a510-8b6829445d7e tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "POST /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.751834 May 26 16:42:16.859609 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 104/207] 10.222.0.102 () {60 vars in 1327 bytes} [Thu May 26 16:42:14 2022] POST /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea/os-volume_attachments => generated 194 bytes in 2755 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:42:17.024771 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-dcb42915-0b36-4f2d-9291-c1652907f639 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:17.036976 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-dcb42915-0b36-4f2d-9291-c1652907f639 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:17.048670 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-dcb42915-0b36-4f2d-9291-c1652907f639 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:17.048670 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-dcb42915-0b36-4f2d-9291-c1652907f639 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1411 microversion: 2.20 time: 0.385977 May 26 16:42:17.048670 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 104/208] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:42:16 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1411 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:42:17.160323 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-34644595-48be-4e2e-a904-94cb8b0f6d4d tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:17.162403 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-34644595-48be-4e2e-a904-94cb8b0f6d4d tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:17.178635 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-34644595-48be-4e2e-a904-94cb8b0f6d4d tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:17.179928 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-34644595-48be-4e2e-a904-94cb8b0f6d4d tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:17.182270 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-34644595-48be-4e2e-a904-94cb8b0f6d4d tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:17.183089 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-34644595-48be-4e2e-a904-94cb8b0f6d4d tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:17.556547 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-34644595-48be-4e2e-a904-94cb8b0f6d4d tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:17.565242 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-34644595-48be-4e2e-a904-94cb8b0f6d4d tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1366 microversion: 2.1 time: 0.413440 May 26 16:42:17.575830 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 105/209] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:17 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1366 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:17.682921 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-ce469184-8373-4cd1-a14a-586094d84844 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:17.684312 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-ce469184-8373-4cd1-a14a-586094d84844 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:17.698930 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ce469184-8373-4cd1-a14a-586094d84844 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:17.699709 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ce469184-8373-4cd1-a14a-586094d84844 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:17.701678 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ce469184-8373-4cd1-a14a-586094d84844 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:17.703791 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ce469184-8373-4cd1-a14a-586094d84844 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:18.047969 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-ce469184-8373-4cd1-a14a-586094d84844 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:18.064176 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-ce469184-8373-4cd1-a14a-586094d84844 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1326 microversion: 2.1 time: 0.389339 May 26 16:42:18.065006 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 105/210] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:17 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1326 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:18.085359 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-b62453ed-c50b-4ce2-b8db-8768ce3e96ee tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:18.086390 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-b62453ed-c50b-4ce2-b8db-8768ce3e96ee tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:18.119749 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b62453ed-c50b-4ce2-b8db-8768ce3e96ee tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:18.125396 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b62453ed-c50b-4ce2-b8db-8768ce3e96ee tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:18.127229 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b62453ed-c50b-4ce2-b8db-8768ce3e96ee tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:18.133679 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b62453ed-c50b-4ce2-b8db-8768ce3e96ee tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:18.507400 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b62453ed-c50b-4ce2-b8db-8768ce3e96ee tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:18.518202 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b62453ed-c50b-4ce2-b8db-8768ce3e96ee tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:18.520227 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b62453ed-c50b-4ce2-b8db-8768ce3e96ee tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:18.521754 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-b62453ed-c50b-4ce2-b8db-8768ce3e96ee tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1411 microversion: 2.20 time: 0.445717 May 26 16:42:18.522436 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 106/211] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:42:18 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1411 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:42:18.588423 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-eb0a8ce7-6f45-4994-8491-3b5f966f4350 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:18.589562 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-eb0a8ce7-6f45-4994-8491-3b5f966f4350 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:18.606131 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-eb0a8ce7-6f45-4994-8491-3b5f966f4350 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:18.606731 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-eb0a8ce7-6f45-4994-8491-3b5f966f4350 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:18.607780 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-eb0a8ce7-6f45-4994-8491-3b5f966f4350 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:18.609096 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-eb0a8ce7-6f45-4994-8491-3b5f966f4350 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:18.796885 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-eb0a8ce7-6f45-4994-8491-3b5f966f4350 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:18.808613 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-eb0a8ce7-6f45-4994-8491-3b5f966f4350 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1366 microversion: 2.1 time: 0.228200 May 26 16:42:18.820531 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 106/212] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:18 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:19.098952 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2fbca13d-2ebd-4518-a583-67815bf88f13 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:19.101254 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2fbca13d-2ebd-4518-a583-67815bf88f13 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:19.120225 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2fbca13d-2ebd-4518-a583-67815bf88f13 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:19.121856 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2fbca13d-2ebd-4518-a583-67815bf88f13 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:19.123653 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2fbca13d-2ebd-4518-a583-67815bf88f13 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:19.141098 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2fbca13d-2ebd-4518-a583-67815bf88f13 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:19.322295 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-74ed0ea3-9ea6-4199-bbe8-9a94f3278365 req-cacadcac-44fd-4c00-b622-af115a162f5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15756f2d-4f17-4b50-b02e-4cf50051ec29", "name": "network-vif-plugged", "status": "completed", "tag": "64f50be8-9caf-42c2-88ea-4042b60bcf83"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:42:19.355038 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-74ed0ea3-9ea6-4199-bbe8-9a94f3278365 req-cacadcac-44fd-4c00-b622-af115a162f5b service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:19.358920 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-74ed0ea3-9ea6-4199-bbe8-9a94f3278365 req-cacadcac-44fd-4c00-b622-af115a162f5b service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:19.399685 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-74ed0ea3-9ea6-4199-bbe8-9a94f3278365 req-cacadcac-44fd-4c00-b622-af115a162f5b service nova] Creating event network-vif-plugged:64f50be8-9caf-42c2-88ea-4042b60bcf83 for instance 15756f2d-4f17-4b50-b02e-4cf50051ec29 on hv-cinder-83607 May 26 16:42:19.415507 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-74ed0ea3-9ea6-4199-bbe8-9a94f3278365 req-cacadcac-44fd-4c00-b622-af115a162f5b service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100194 May 26 16:42:19.417615 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 107/213] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:42:19.560950 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-3f6ce940-244a-4775-ab57-cb228fd1a6ed tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:19.563859 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-3f6ce940-244a-4775-ab57-cb228fd1a6ed tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:19.577718 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3f6ce940-244a-4775-ab57-cb228fd1a6ed tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:19.578580 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3f6ce940-244a-4775-ab57-cb228fd1a6ed tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:19.579720 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3f6ce940-244a-4775-ab57-cb228fd1a6ed tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:19.580489 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3f6ce940-244a-4775-ab57-cb228fd1a6ed tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:19.624435 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-2fbca13d-2ebd-4518-a583-67815bf88f13 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:19.639633 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2fbca13d-2ebd-4518-a583-67815bf88f13 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1520 microversion: 2.1 time: 0.556243 May 26 16:42:19.640684 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 107/214] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:19 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1520 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:19.671245 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d9ecf143-093d-44f4-994c-a2d5af4a7232 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:42:19.673419 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d9ecf143-093d-44f4-994c-a2d5af4a7232 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:19.684914 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d9ecf143-093d-44f4-994c-a2d5af4a7232 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:19.686763 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d9ecf143-093d-44f4-994c-a2d5af4a7232 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:19.688406 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d9ecf143-093d-44f4-994c-a2d5af4a7232 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:19.689417 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d9ecf143-093d-44f4-994c-a2d5af4a7232 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:19.786057 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.objects.instance [None req-d9ecf143-093d-44f4-994c-a2d5af4a7232 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lazy-loading 'flavor' on Instance uuid d1d7f247-4a0f-43cb-893b-a937419b4c4c {{(pid=124266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:42:19.939185 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-3f6ce940-244a-4775-ab57-cb228fd1a6ed tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:19.943439 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=100 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:19.957524 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-3f6ce940-244a-4775-ab57-cb228fd1a6ed tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:19.959611 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-3f6ce940-244a-4775-ab57-cb228fd1a6ed tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:19.961197 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-3f6ce940-244a-4775-ab57-cb228fd1a6ed tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1411 microversion: 2.20 time: 0.412966 May 26 16:42:19.962002 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 108/215] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:42:19 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1411 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:42:19.978775 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-dae57db4-0a6e-4c2c-bbed-8a791d8947c5 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:19.979609 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-dae57db4-0a6e-4c2c-bbed-8a791d8947c5 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:19.996806 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-dae57db4-0a6e-4c2c-bbed-8a791d8947c5 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:19.997376 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-dae57db4-0a6e-4c2c-bbed-8a791d8947c5 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:19.998426 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-dae57db4-0a6e-4c2c-bbed-8a791d8947c5 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:19.999089 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-dae57db4-0a6e-4c2c-bbed-8a791d8947c5 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:20.152096 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d9ecf143-093d-44f4-994c-a2d5af4a7232 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "POST /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c/action" status: 200 len: 32 microversion: 2.1 time: 0.487718 May 26 16:42:20.154850 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 108/216] 10.222.0.102 () {60 vars in 1282 bytes} [Thu May 26 16:42:19 2022] POST /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c/action => generated 32 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 16:42:20.170798 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d2e191f8-4243-4dc4-a86b-e0407af8328f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:20.172093 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d2e191f8-4243-4dc4-a86b-e0407af8328f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:20.180706 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d2e191f8-4243-4dc4-a86b-e0407af8328f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:20.181451 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d2e191f8-4243-4dc4-a86b-e0407af8328f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:20.182482 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d2e191f8-4243-4dc4-a86b-e0407af8328f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:20.183088 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d2e191f8-4243-4dc4-a86b-e0407af8328f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:20.485579 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-dae57db4-0a6e-4c2c-bbed-8a791d8947c5 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:20.497328 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-dae57db4-0a6e-4c2c-bbed-8a791d8947c5 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1366 microversion: 2.1 time: 0.523239 May 26 16:42:20.498056 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 109/217] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:19 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1366 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:20.559926 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d2e191f8-4243-4dc4-a86b-e0407af8328f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:20.564960 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:20.596024 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d2e191f8-4243-4dc4-a86b-e0407af8328f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.432893 May 26 16:42:20.597055 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 109/218] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:20 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:20.981796 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-6ed8141b-5aaf-4e6d-8b78-d957205d031c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:20.983266 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-6ed8141b-5aaf-4e6d-8b78-d957205d031c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:20.992301 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-6ed8141b-5aaf-4e6d-8b78-d957205d031c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:20.993572 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-6ed8141b-5aaf-4e6d-8b78-d957205d031c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:20.994392 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-6ed8141b-5aaf-4e6d-8b78-d957205d031c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:20.995018 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-6ed8141b-5aaf-4e6d-8b78-d957205d031c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:21.408663 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-6ed8141b-5aaf-4e6d-8b78-d957205d031c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:21.423396 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-6ed8141b-5aaf-4e6d-8b78-d957205d031c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:21.427641 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-6ed8141b-5aaf-4e6d-8b78-d957205d031c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:21.433533 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-6ed8141b-5aaf-4e6d-8b78-d957205d031c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1604 microversion: 2.20 time: 0.453393 May 26 16:42:21.435135 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 110/219] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:42:20 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1604 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:42:21.479694 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-96e7b6c4-b374-42c0-aea8-c9b1406d47df tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:21.491981 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-96e7b6c4-b374-42c0-aea8-c9b1406d47df tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:21.520726 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-96e7b6c4-b374-42c0-aea8-c9b1406d47df tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:21.521508 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-96e7b6c4-b374-42c0-aea8-c9b1406d47df tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:21.523142 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-96e7b6c4-b374-42c0-aea8-c9b1406d47df tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:21.528519 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-96e7b6c4-b374-42c0-aea8-c9b1406d47df tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:21.528899 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-25aae1b8-75bc-4abb-b4f1-58e1dfb9a02a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:21.531352 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-25aae1b8-75bc-4abb-b4f1-58e1dfb9a02a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:21.560634 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-25aae1b8-75bc-4abb-b4f1-58e1dfb9a02a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:21.563192 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-25aae1b8-75bc-4abb-b4f1-58e1dfb9a02a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:21.564910 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-25aae1b8-75bc-4abb-b4f1-58e1dfb9a02a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:21.565913 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-25aae1b8-75bc-4abb-b4f1-58e1dfb9a02a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:21.803278 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-96e7b6c4-b374-42c0-aea8-c9b1406d47df tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.335693 May 26 16:42:21.804734 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 110/220] 10.222.0.102 () {60 vars in 1320 bytes} [Thu May 26 16:42:21 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9/os-interface => generated 285 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:42:21.819382 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-efa142d8-22f7-4b16-a7d9-8d9f4e0059ae tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:21.821634 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-efa142d8-22f7-4b16-a7d9-8d9f4e0059ae tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:21.836430 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-efa142d8-22f7-4b16-a7d9-8d9f4e0059ae tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:21.838372 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-efa142d8-22f7-4b16-a7d9-8d9f4e0059ae tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:21.840325 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-efa142d8-22f7-4b16-a7d9-8d9f4e0059ae tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:21.841972 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-efa142d8-22f7-4b16-a7d9-8d9f4e0059ae tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:21.939554 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-25aae1b8-75bc-4abb-b4f1-58e1dfb9a02a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:21.958129 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-25aae1b8-75bc-4abb-b4f1-58e1dfb9a02a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1366 microversion: 2.1 time: 0.444699 May 26 16:42:21.960361 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 111/221] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:21 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1366 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:42:22.106598 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-efa142d8-22f7-4b16-a7d9-8d9f4e0059ae tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:22.120809 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-efa142d8-22f7-4b16-a7d9-8d9f4e0059ae tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.313909 May 26 16:42:22.136512 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 111/222] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:21 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:22.992312 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-a33ec1ee-bc6c-4546-8a6f-b200a41cf5b4 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:22.993937 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-a33ec1ee-bc6c-4546-8a6f-b200a41cf5b4 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:23.020701 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a33ec1ee-bc6c-4546-8a6f-b200a41cf5b4 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:23.021807 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a33ec1ee-bc6c-4546-8a6f-b200a41cf5b4 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:23.023136 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a33ec1ee-bc6c-4546-8a6f-b200a41cf5b4 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:23.023896 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a33ec1ee-bc6c-4546-8a6f-b200a41cf5b4 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:23.150998 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-464be88f-3ab1-481e-8c61-1cfabce249fc tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:23.154083 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-464be88f-3ab1-481e-8c61-1cfabce249fc tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:23.186148 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-464be88f-3ab1-481e-8c61-1cfabce249fc tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:23.191264 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-464be88f-3ab1-481e-8c61-1cfabce249fc tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:23.193858 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-464be88f-3ab1-481e-8c61-1cfabce249fc tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:23.196875 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-464be88f-3ab1-481e-8c61-1cfabce249fc tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:23.772435 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-a33ec1ee-bc6c-4546-8a6f-b200a41cf5b4 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:23.786547 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-a33ec1ee-bc6c-4546-8a6f-b200a41cf5b4 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1366 microversion: 2.1 time: 0.802909 May 26 16:42:23.787519 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 112/223] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:22 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1366 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:23.811784 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-464be88f-3ab1-481e-8c61-1cfabce249fc tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:23.832403 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-464be88f-3ab1-481e-8c61-1cfabce249fc tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.691436 May 26 16:42:23.833422 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 112/224] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:23 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:24.336343 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-79e636f4-6eae-41f0-8827-2553fcb64460 req-f7915d93-28d5-4e1e-912b-ae34a0ce3288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a636d450-9d10-45a5-9982-9e10393fc4a9", "tag": "444eb6a1-a511-4e39-a006-252d0ba39886"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:42:24.378983 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-79e636f4-6eae-41f0-8827-2553fcb64460 req-f7915d93-28d5-4e1e-912b-ae34a0ce3288 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:24.379965 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-79e636f4-6eae-41f0-8827-2553fcb64460 req-f7915d93-28d5-4e1e-912b-ae34a0ce3288 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:24.410932 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-79e636f4-6eae-41f0-8827-2553fcb64460 req-f7915d93-28d5-4e1e-912b-ae34a0ce3288 service nova] Creating event network-changed:444eb6a1-a511-4e39-a006-252d0ba39886 for instance a636d450-9d10-45a5-9982-9e10393fc4a9 on hv-cinder-83607 May 26 16:42:24.431285 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-79e636f4-6eae-41f0-8827-2553fcb64460 req-f7915d93-28d5-4e1e-912b-ae34a0ce3288 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100094 May 26 16:42:24.434090 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 113/225] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:42:24.819006 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-14513955-a3b9-4acc-b7ed-ce4ea61a515e tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:24.819801 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-14513955-a3b9-4acc-b7ed-ce4ea61a515e tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:24.847935 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-14513955-a3b9-4acc-b7ed-ce4ea61a515e tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:24.848663 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-14513955-a3b9-4acc-b7ed-ce4ea61a515e tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:24.849565 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-14513955-a3b9-4acc-b7ed-ce4ea61a515e tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:24.850019 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-14513955-a3b9-4acc-b7ed-ce4ea61a515e tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:24.870681 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-9b46e9fe-16df-41d8-9f41-71180c431e44 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:24.876034 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-9b46e9fe-16df-41d8-9f41-71180c431e44 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:24.907349 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9b46e9fe-16df-41d8-9f41-71180c431e44 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:24.915018 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9b46e9fe-16df-41d8-9f41-71180c431e44 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:24.917866 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9b46e9fe-16df-41d8-9f41-71180c431e44 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:24.919041 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9b46e9fe-16df-41d8-9f41-71180c431e44 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:25.487398 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-9b46e9fe-16df-41d8-9f41-71180c431e44 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:25.495390 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-14513955-a3b9-4acc-b7ed-ce4ea61a515e tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:25.503580 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-14513955-a3b9-4acc-b7ed-ce4ea61a515e tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1552 microversion: 2.1 time: 0.689682 May 26 16:42:25.504199 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 113/226] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:24 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1552 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:42:25.532897 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e25f0192-20f1-47a6-bc2c-40c0c22e6a2c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:25.533806 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e25f0192-20f1-47a6-bc2c-40c0c22e6a2c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:25.542850 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-9b46e9fe-16df-41d8-9f41-71180c431e44 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.686396 May 26 16:42:25.545631 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e25f0192-20f1-47a6-bc2c-40c0c22e6a2c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:25.545942 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 114/227] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:24 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:25.546618 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e25f0192-20f1-47a6-bc2c-40c0c22e6a2c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:25.548062 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e25f0192-20f1-47a6-bc2c-40c0c22e6a2c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:25.548916 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e25f0192-20f1-47a6-bc2c-40c0c22e6a2c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:25.698562 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e25f0192-20f1-47a6-bc2c-40c0c22e6a2c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.173553 May 26 16:42:25.700360 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 114/228] 10.222.0.102 () {58 vars in 1279 bytes} [Thu May 26 16:42:25 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29/os-interface => generated 284 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:42:26.567002 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-f6e16d7d-2515-46aa-8e42-0b8ecdbbe979 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:26.570333 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-f6e16d7d-2515-46aa-8e42-0b8ecdbbe979 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:26.588585 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f6e16d7d-2515-46aa-8e42-0b8ecdbbe979 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:26.591008 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f6e16d7d-2515-46aa-8e42-0b8ecdbbe979 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:26.595590 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f6e16d7d-2515-46aa-8e42-0b8ecdbbe979 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:26.596431 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f6e16d7d-2515-46aa-8e42-0b8ecdbbe979 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:27.239723 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-f6e16d7d-2515-46aa-8e42-0b8ecdbbe979 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:27.276756 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-f6e16d7d-2515-46aa-8e42-0b8ecdbbe979 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.716345 May 26 16:42:27.290119 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 115/229] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:26 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:28.308124 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3c26ce26-1eb7-4470-bc4d-b7f77dd210b1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:28.309287 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-3c26ce26-1eb7-4470-bc4d-b7f77dd210b1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:28.347859 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3c26ce26-1eb7-4470-bc4d-b7f77dd210b1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:28.349019 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3c26ce26-1eb7-4470-bc4d-b7f77dd210b1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:28.349195 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-cd76f5dd-1a91-4d36-8796-23ead7bb344d req-54fd9400-529d-432a-b15f-87464e12f1c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15756f2d-4f17-4b50-b02e-4cf50051ec29", "tag": "64f50be8-9caf-42c2-88ea-4042b60bcf83"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:42:28.351520 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3c26ce26-1eb7-4470-bc4d-b7f77dd210b1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:28.353210 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3c26ce26-1eb7-4470-bc4d-b7f77dd210b1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:28.367517 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-cd76f5dd-1a91-4d36-8796-23ead7bb344d req-54fd9400-529d-432a-b15f-87464e12f1c1 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:28.370660 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-cd76f5dd-1a91-4d36-8796-23ead7bb344d req-54fd9400-529d-432a-b15f-87464e12f1c1 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:28.405913 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-cd76f5dd-1a91-4d36-8796-23ead7bb344d req-54fd9400-529d-432a-b15f-87464e12f1c1 service nova] Creating event network-changed:64f50be8-9caf-42c2-88ea-4042b60bcf83 for instance 15756f2d-4f17-4b50-b02e-4cf50051ec29 on hv-cinder-83607 May 26 16:42:28.412903 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-cd76f5dd-1a91-4d36-8796-23ead7bb344d req-54fd9400-529d-432a-b15f-87464e12f1c1 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068185 May 26 16:42:28.416960 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 116/230] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:42:28.701855 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3c26ce26-1eb7-4470-bc4d-b7f77dd210b1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:28.720665 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-3c26ce26-1eb7-4470-bc4d-b7f77dd210b1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.422404 May 26 16:42:28.722508 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 115/231] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:28 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:29.748717 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-e49cc44f-2c96-43a7-acd9-f808c68633e0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:29.749975 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-e49cc44f-2c96-43a7-acd9-f808c68633e0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:29.804740 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e49cc44f-2c96-43a7-acd9-f808c68633e0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:29.807078 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e49cc44f-2c96-43a7-acd9-f808c68633e0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:29.814451 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e49cc44f-2c96-43a7-acd9-f808c68633e0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:29.815378 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e49cc44f-2c96-43a7-acd9-f808c68633e0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:30.049441 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-e49cc44f-2c96-43a7-acd9-f808c68633e0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:30.065919 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-e49cc44f-2c96-43a7-acd9-f808c68633e0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.329446 May 26 16:42:30.067395 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 117/232] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:29 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:31.085924 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-20d1b26e-2274-4d99-8d0b-3cf3043f0b56 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:31.086550 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-20d1b26e-2274-4d99-8d0b-3cf3043f0b56 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:31.094024 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-20d1b26e-2274-4d99-8d0b-3cf3043f0b56 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:31.094856 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-20d1b26e-2274-4d99-8d0b-3cf3043f0b56 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:31.095677 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-20d1b26e-2274-4d99-8d0b-3cf3043f0b56 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:31.096123 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-20d1b26e-2274-4d99-8d0b-3cf3043f0b56 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:31.308414 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-20d1b26e-2274-4d99-8d0b-3cf3043f0b56 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:31.322847 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-20d1b26e-2274-4d99-8d0b-3cf3043f0b56 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.240495 May 26 16:42:31.324454 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 116/233] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:31 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:32.356271 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-78b4c80a-f51b-4916-9eeb-02e9718c8e63 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:32.358662 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-78b4c80a-f51b-4916-9eeb-02e9718c8e63 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:32.371111 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_api:SELECT=76 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:32.375952 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-78b4c80a-f51b-4916-9eeb-02e9718c8e63 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:32.377204 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-78b4c80a-f51b-4916-9eeb-02e9718c8e63 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:32.379174 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-78b4c80a-f51b-4916-9eeb-02e9718c8e63 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:32.380255 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-78b4c80a-f51b-4916-9eeb-02e9718c8e63 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:32.441802 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-5ce1c525-155c-47e9-83f2-88da83374710 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1626561551", "imageRef": "d74c4a51-21fe-41d5-865a-cb93604ac3aa", "flavorRef": "452", "networks": [{"uuid": "e501901b-6f86-4144-9120-72f2aacdc277"}]}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:42:32.456995 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=60 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:32.524636 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.network.neutron [None req-5ce1c525-155c-47e9-83f2-88da83374710 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] validate_networks() for [('e501901b-6f86-4144-9120-72f2aacdc277', None, None, None, None, None)] {{(pid=124266) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:42:33.345383 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-78b4c80a-f51b-4916-9eeb-02e9718c8e63 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:33.387639 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-78b4c80a-f51b-4916-9eeb-02e9718c8e63 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 1.028396 May 26 16:42:33.387639 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 118/234] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:32 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:33.394484 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-d3061356-7e26-433e-a4f9-cadbef31840b tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:33.394937 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-d3061356-7e26-433e-a4f9-cadbef31840b tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:33.407899 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d3061356-7e26-433e-a4f9-cadbef31840b tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:33.408353 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d3061356-7e26-433e-a4f9-cadbef31840b tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:33.409394 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d3061356-7e26-433e-a4f9-cadbef31840b tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:33.411617 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d3061356-7e26-433e-a4f9-cadbef31840b tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:33.467500 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-d3061356-7e26-433e-a4f9-cadbef31840b tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Going to try to terminate instance {{(pid=124267) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 16:42:33.776433 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-d3061356-7e26-433e-a4f9-cadbef31840b tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "DELETE /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 204 len: 0 microversion: 2.1 time: 0.396203 May 26 16:42:33.778571 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 119/235] 10.222.0.102 () {58 vars in 1243 bytes} [Thu May 26 16:42:33 2022] DELETE /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 16:42:33.789600 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-098dcbf9-77cf-4f6b-bbf8-4525c9ed62e1 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:33.790964 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-098dcbf9-77cf-4f6b-bbf8-4525c9ed62e1 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:33.803082 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-098dcbf9-77cf-4f6b-bbf8-4525c9ed62e1 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:33.804042 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-098dcbf9-77cf-4f6b-bbf8-4525c9ed62e1 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:33.805212 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-098dcbf9-77cf-4f6b-bbf8-4525c9ed62e1 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:33.807694 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-098dcbf9-77cf-4f6b-bbf8-4525c9ed62e1 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:34.036730 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-5ce1c525-155c-47e9-83f2-88da83374710 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Flavor limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:42:34.037399 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-5ce1c525-155c-47e9-83f2-88da83374710 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Image limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:42:34.038742 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-5ce1c525-155c-47e9-83f2-88da83374710 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Flavor pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:42:34.039184 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-5ce1c525-155c-47e9-83f2-88da83374710 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Image pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:42:34.039656 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-5ce1c525-155c-47e9-83f2-88da83374710 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:42:34.064207 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5ce1c525-155c-47e9-83f2-88da83374710 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:34.065057 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5ce1c525-155c-47e9-83f2-88da83374710 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:34.066124 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5ce1c525-155c-47e9-83f2-88da83374710 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:34.066775 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5ce1c525-155c-47e9-83f2-88da83374710 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:34.074053 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-098dcbf9-77cf-4f6b-bbf8-4525c9ed62e1 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:34.085019 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-098dcbf9-77cf-4f6b-bbf8-4525c9ed62e1 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1557 microversion: 2.1 time: 0.301616 May 26 16:42:34.088523 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 120/236] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:33 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1557 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:42:34.098330 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-5ce1c525-155c-47e9-83f2-88da83374710 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Getting quotas for project 9f81bd02cdf94ff98c1e9534199b425c. Resources: {'cores', 'instances', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:42:34.104643 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-5ce1c525-155c-47e9-83f2-88da83374710 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Getting quotas for user 9c0fb73a262843f89285a6e161a1abed and project 9f81bd02cdf94ff98c1e9534199b425c. Resources: {'cores', 'instances', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:42:34.118566 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-5ce1c525-155c-47e9-83f2-88da83374710 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Going to run 1 instances... {{(pid=124266) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:42:34.121917 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-5ce1c525-155c-47e9-83f2-88da83374710 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: 5ae2e40f-2c92-4e19-8126-ba183bb7b14b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d74c4a51-21fe-41d5-865a-cb93604ac3aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:42:34.191354 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-5ce1c525-155c-47e9-83f2-88da83374710 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.758490 May 26 16:42:34.193193 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 117/237] 10.222.0.102 () {60 vars in 1151 bytes} [Thu May 26 16:42:32 2022] POST /compute/v2.1/servers => generated 382 bytes in 1762 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 16:42:34.204553 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-ec3e10c8-ad2b-4978-9e64-880953552361 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:34.205068 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-ec3e10c8-ad2b-4978-9e64-880953552361 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: 5ae2e40f-2c92-4e19-8126-ba183bb7b14b] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:34.273513 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-ec3e10c8-ad2b-4978-9e64-880953552361 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:34.281550 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-ec3e10c8-ad2b-4978-9e64-880953552361 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b" status: 200 len: 1218 microversion: 2.1 time: 0.082036 May 26 16:42:34.282722 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 121/238] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:34 2022] GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:34.402947 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d380040e-8af4-4911-bc84-b3a345c32492 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:34.403778 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d380040e-8af4-4911-bc84-b3a345c32492 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:34.414227 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d380040e-8af4-4911-bc84-b3a345c32492 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:34.415635 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d380040e-8af4-4911-bc84-b3a345c32492 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:34.416704 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d380040e-8af4-4911-bc84-b3a345c32492 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:34.417318 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d380040e-8af4-4911-bc84-b3a345c32492 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:34.727026 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d380040e-8af4-4911-bc84-b3a345c32492 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:34.736050 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d380040e-8af4-4911-bc84-b3a345c32492 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.337641 May 26 16:42:34.746436 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 118/239] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:34 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:35.104540 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-3d646766-6916-47c8-82bc-6279df04fdad tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:35.105826 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-3d646766-6916-47c8-82bc-6279df04fdad tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:35.112795 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3d646766-6916-47c8-82bc-6279df04fdad tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:35.113484 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3d646766-6916-47c8-82bc-6279df04fdad tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:35.114489 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3d646766-6916-47c8-82bc-6279df04fdad tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:35.115082 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3d646766-6916-47c8-82bc-6279df04fdad tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:35.309795 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-277292d7-df36-4969-8b64-ac69e44520fa tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:35.311057 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-277292d7-df36-4969-8b64-ac69e44520fa tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: 5ae2e40f-2c92-4e19-8126-ba183bb7b14b] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:35.326169 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-277292d7-df36-4969-8b64-ac69e44520fa tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:35.326503 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-277292d7-df36-4969-8b64-ac69e44520fa tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:35.331887 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-277292d7-df36-4969-8b64-ac69e44520fa tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:35.338268 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-277292d7-df36-4969-8b64-ac69e44520fa tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:35.455997 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-3d646766-6916-47c8-82bc-6279df04fdad tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:35.465024 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-3d646766-6916-47c8-82bc-6279df04fdad tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1557 microversion: 2.1 time: 0.365168 May 26 16:42:35.476488 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 122/240] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:35 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1557 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:42:35.504066 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-277292d7-df36-4969-8b64-ac69e44520fa tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:35.515456 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-277292d7-df36-4969-8b64-ac69e44520fa tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b" status: 200 len: 1222 microversion: 2.1 time: 0.210478 May 26 16:42:35.516342 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 119/241] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:35 2022] GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b => generated 1222 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:42:35.757818 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-210169d0-babc-449e-a943-f95edd92a180 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:35.758738 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-210169d0-babc-449e-a943-f95edd92a180 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:35.769811 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-210169d0-babc-449e-a943-f95edd92a180 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:35.770276 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-210169d0-babc-449e-a943-f95edd92a180 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:35.771732 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-210169d0-babc-449e-a943-f95edd92a180 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:35.774143 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-210169d0-babc-449e-a943-f95edd92a180 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:36.039644 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-210169d0-babc-449e-a943-f95edd92a180 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:36.053980 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-210169d0-babc-449e-a943-f95edd92a180 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.298392 May 26 16:42:36.054896 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 123/242] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:35 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:36.486439 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-99516a4f-05a7-44a4-835e-809abe0b3737 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:36.487918 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-99516a4f-05a7-44a4-835e-809abe0b3737 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:36.498166 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-99516a4f-05a7-44a4-835e-809abe0b3737 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:36.504201 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-99516a4f-05a7-44a4-835e-809abe0b3737 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:36.506210 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-99516a4f-05a7-44a4-835e-809abe0b3737 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:36.509348 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-99516a4f-05a7-44a4-835e-809abe0b3737 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:36.555603 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-cd61a2b2-5ac7-44a0-8219-f5ad2651708e tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:36.557648 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-cd61a2b2-5ac7-44a0-8219-f5ad2651708e tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: 5ae2e40f-2c92-4e19-8126-ba183bb7b14b] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:36.577640 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-cd61a2b2-5ac7-44a0-8219-f5ad2651708e tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:36.580064 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-cd61a2b2-5ac7-44a0-8219-f5ad2651708e tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:36.581875 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-cd61a2b2-5ac7-44a0-8219-f5ad2651708e tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:36.583767 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-cd61a2b2-5ac7-44a0-8219-f5ad2651708e tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:36.741581 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-cd61a2b2-5ac7-44a0-8219-f5ad2651708e tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:36.753188 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-cd61a2b2-5ac7-44a0-8219-f5ad2651708e tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b" status: 200 len: 1270 microversion: 2.1 time: 0.213777 May 26 16:42:36.754377 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 124/243] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:36 2022] GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b => generated 1270 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:36.838267 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-99516a4f-05a7-44a4-835e-809abe0b3737 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:36.847967 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-99516a4f-05a7-44a4-835e-809abe0b3737 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1557 microversion: 2.1 time: 0.367464 May 26 16:42:36.858671 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 120/244] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:36 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1557 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:37.087871 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-60841c90-42fb-4cd9-adf0-059d632f4730 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:37.088931 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-60841c90-42fb-4cd9-adf0-059d632f4730 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:37.099067 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-60841c90-42fb-4cd9-adf0-059d632f4730 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:37.099702 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-60841c90-42fb-4cd9-adf0-059d632f4730 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:37.100694 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-60841c90-42fb-4cd9-adf0-059d632f4730 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:37.101415 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-60841c90-42fb-4cd9-adf0-059d632f4730 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:37.340732 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-60841c90-42fb-4cd9-adf0-059d632f4730 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:37.353261 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-60841c90-42fb-4cd9-adf0-059d632f4730 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.272941 May 26 16:42:37.354584 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 125/245] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:37 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:42:37.771999 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-81d3bf82-e1f2-4246-80f8-7f9d186e55fd tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:37.773308 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-81d3bf82-e1f2-4246-80f8-7f9d186e55fd tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: 5ae2e40f-2c92-4e19-8126-ba183bb7b14b] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:37.784544 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-81d3bf82-e1f2-4246-80f8-7f9d186e55fd tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:37.785318 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-81d3bf82-e1f2-4246-80f8-7f9d186e55fd tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:37.786120 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-81d3bf82-e1f2-4246-80f8-7f9d186e55fd tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:37.786768 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-81d3bf82-e1f2-4246-80f8-7f9d186e55fd tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:37.866205 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-4bfa0055-704c-4264-9385-fb801893b502 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:37.867111 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-4bfa0055-704c-4264-9385-fb801893b502 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:37.880237 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4bfa0055-704c-4264-9385-fb801893b502 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:37.881390 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4bfa0055-704c-4264-9385-fb801893b502 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:37.882755 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4bfa0055-704c-4264-9385-fb801893b502 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:37.883516 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4bfa0055-704c-4264-9385-fb801893b502 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:37.888930 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-81d3bf82-e1f2-4246-80f8-7f9d186e55fd tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:37.895469 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:37.907114 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-81d3bf82-e1f2-4246-80f8-7f9d186e55fd tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b" status: 200 len: 1276 microversion: 2.1 time: 0.139317 May 26 16:42:37.907738 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 121/246] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:37 2022] GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:42:38.346407 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-4bfa0055-704c-4264-9385-fb801893b502 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:38.366335 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-4bfa0055-704c-4264-9385-fb801893b502 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1557 microversion: 2.1 time: 0.504395 May 26 16:42:38.367371 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 126/247] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:37 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1557 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:42:38.394790 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-dc53dcd9-0267-4411-aa1c-1fe5d8c9b9fe tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:38.395462 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-dc53dcd9-0267-4411-aa1c-1fe5d8c9b9fe tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:38.411666 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dc53dcd9-0267-4411-aa1c-1fe5d8c9b9fe tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:38.413341 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dc53dcd9-0267-4411-aa1c-1fe5d8c9b9fe tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:38.415596 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dc53dcd9-0267-4411-aa1c-1fe5d8c9b9fe tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:38.416956 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dc53dcd9-0267-4411-aa1c-1fe5d8c9b9fe tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:38.773609 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-dc53dcd9-0267-4411-aa1c-1fe5d8c9b9fe tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:38.797443 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-dc53dcd9-0267-4411-aa1c-1fe5d8c9b9fe tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.422007 May 26 16:42:38.799376 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 122/248] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:38 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:38.927478 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-9bdb726a-976b-45ef-8935-d5f6e3f45127 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:38.928826 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-9bdb726a-976b-45ef-8935-d5f6e3f45127 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: 5ae2e40f-2c92-4e19-8126-ba183bb7b14b] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:38.936297 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9bdb726a-976b-45ef-8935-d5f6e3f45127 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:38.937218 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9bdb726a-976b-45ef-8935-d5f6e3f45127 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:38.938359 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9bdb726a-976b-45ef-8935-d5f6e3f45127 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:38.938842 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9bdb726a-976b-45ef-8935-d5f6e3f45127 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:39.315769 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-9bdb726a-976b-45ef-8935-d5f6e3f45127 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:39.354392 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-35cca39a-636d-415f-a680-a841477b2c0b req-420630ae-143e-473a-ad17-70e0e349c267 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bcd849c-2f03-44d0-9c4b-350431056dea", "name": "network-vif-deleted", "tag": "05f50936-b66b-4d09-b68b-ab827d36742f"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:42:39.356922 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-9bdb726a-976b-45ef-8935-d5f6e3f45127 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b" status: 200 len: 1276 microversion: 2.1 time: 0.432830 May 26 16:42:39.372514 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 127/249] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:38 2022] GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b => generated 1276 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:39.372872 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-35cca39a-636d-415f-a680-a841477b2c0b req-420630ae-143e-473a-ad17-70e0e349c267 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:39.372872 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-35cca39a-636d-415f-a680-a841477b2c0b req-420630ae-143e-473a-ad17-70e0e349c267 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:39.390133 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-e7fa0f24-aff8-457b-9bba-530a2f04a191 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:39.394464 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-e7fa0f24-aff8-457b-9bba-530a2f04a191 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:39.431683 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e7fa0f24-aff8-457b-9bba-530a2f04a191 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:39.433921 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e7fa0f24-aff8-457b-9bba-530a2f04a191 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:39.438190 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e7fa0f24-aff8-457b-9bba-530a2f04a191 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:39.442682 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e7fa0f24-aff8-457b-9bba-530a2f04a191 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:39.461684 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-35cca39a-636d-415f-a680-a841477b2c0b req-420630ae-143e-473a-ad17-70e0e349c267 service nova] Creating event network-vif-deleted:05f50936-b66b-4d09-b68b-ab827d36742f for instance 6bcd849c-2f03-44d0-9c4b-350431056dea on hv-cinder-83607 May 26 16:42:39.485744 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-35cca39a-636d-415f-a680-a841477b2c0b req-420630ae-143e-473a-ad17-70e0e349c267 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145123 May 26 16:42:39.487701 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 123/250] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:42:39.630353 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-e7fa0f24-aff8-457b-9bba-530a2f04a191 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:39.648570 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-e7fa0f24-aff8-457b-9bba-530a2f04a191 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1350 microversion: 2.1 time: 0.266808 May 26 16:42:39.650342 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 128/251] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:39 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1350 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:39.819644 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-fa7b3d54-d456-4957-ad6c-77d7738e7aa5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:39.820421 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-fa7b3d54-d456-4957-ad6c-77d7738e7aa5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:39.848530 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fa7b3d54-d456-4957-ad6c-77d7738e7aa5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:39.854194 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fa7b3d54-d456-4957-ad6c-77d7738e7aa5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:39.857900 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fa7b3d54-d456-4957-ad6c-77d7738e7aa5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:39.860508 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fa7b3d54-d456-4957-ad6c-77d7738e7aa5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:40.327880 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-fa7b3d54-d456-4957-ad6c-77d7738e7aa5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:40.345739 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-fa7b3d54-d456-4957-ad6c-77d7738e7aa5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.533123 May 26 16:42:40.361229 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 124/252] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:39 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:40.385306 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-e54e04cb-9569-4b85-be37-7f0b8f82c9ee tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:40.386393 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-e54e04cb-9569-4b85-be37-7f0b8f82c9ee tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: 5ae2e40f-2c92-4e19-8126-ba183bb7b14b] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:40.395086 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e54e04cb-9569-4b85-be37-7f0b8f82c9ee tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:40.395889 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e54e04cb-9569-4b85-be37-7f0b8f82c9ee tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:40.397256 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e54e04cb-9569-4b85-be37-7f0b8f82c9ee tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:40.397885 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e54e04cb-9569-4b85-be37-7f0b8f82c9ee tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:40.667176 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-214ef12a-5cbc-4e71-a47c-36699760e053 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:40.668188 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-214ef12a-5cbc-4e71-a47c-36699760e053 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:40.676070 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-214ef12a-5cbc-4e71-a47c-36699760e053 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:40.679393 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-214ef12a-5cbc-4e71-a47c-36699760e053 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:40.681401 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-214ef12a-5cbc-4e71-a47c-36699760e053 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:40.682343 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-214ef12a-5cbc-4e71-a47c-36699760e053 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:40.692269 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-e54e04cb-9569-4b85-be37-7f0b8f82c9ee tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:40.720467 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-e54e04cb-9569-4b85-be37-7f0b8f82c9ee tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b" status: 200 len: 1318 microversion: 2.1 time: 0.339576 May 26 16:42:40.724923 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 129/253] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:40 2022] GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b => generated 1318 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:40.750478 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-214ef12a-5cbc-4e71-a47c-36699760e053 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:40.752706 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-214ef12a-5cbc-4e71-a47c-36699760e053 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:40.754464 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.objects.instance [None req-214ef12a-5cbc-4e71-a47c-36699760e053 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lazy-loading 'fault' on Instance uuid 6bcd849c-2f03-44d0-9c4b-350431056dea {{(pid=124266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:42:40.888114 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-214ef12a-5cbc-4e71-a47c-36699760e053 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b7990551ac458cb94c8bc922152650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b15e7956a347cba0b1dca0a45c8482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:40.911907 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-214ef12a-5cbc-4e71-a47c-36699760e053 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 200 len: 1309 microversion: 2.1 time: 0.248397 May 26 16:42:40.922560 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 125/254] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:40 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 1309 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:41.373220 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-0195ed95-28a4-4488-bd0c-86f75e10cb16 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:41.373965 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-0195ed95-28a4-4488-bd0c-86f75e10cb16 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:41.383100 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0195ed95-28a4-4488-bd0c-86f75e10cb16 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:41.383629 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0195ed95-28a4-4488-bd0c-86f75e10cb16 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:41.384999 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0195ed95-28a4-4488-bd0c-86f75e10cb16 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:41.385515 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0195ed95-28a4-4488-bd0c-86f75e10cb16 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:41.528700 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-b24deab6-907a-426b-b6fe-0ce9832a0549 req-97eb20e9-d259-4c2d-bf18-c5eff6951a33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ae2e40f-2c92-4e19-8126-ba183bb7b14b", "tag": "f23e1dc1-523f-4d3b-8009-7b28b75b6bcd"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:42:41.540471 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-b24deab6-907a-426b-b6fe-0ce9832a0549 req-97eb20e9-d259-4c2d-bf18-c5eff6951a33 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:41.540923 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-b24deab6-907a-426b-b6fe-0ce9832a0549 req-97eb20e9-d259-4c2d-bf18-c5eff6951a33 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:41.556253 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-b24deab6-907a-426b-b6fe-0ce9832a0549 req-97eb20e9-d259-4c2d-bf18-c5eff6951a33 service nova] Creating event network-changed:f23e1dc1-523f-4d3b-8009-7b28b75b6bcd for instance 5ae2e40f-2c92-4e19-8126-ba183bb7b14b on hv-cinder-83607 May 26 16:42:41.563357 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-b24deab6-907a-426b-b6fe-0ce9832a0549 req-97eb20e9-d259-4c2d-bf18-c5eff6951a33 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038210 May 26 16:42:41.564682 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 126/255] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:42:41.629173 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-0195ed95-28a4-4488-bd0c-86f75e10cb16 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:41.639526 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-0195ed95-28a4-4488-bd0c-86f75e10cb16 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.271812 May 26 16:42:41.640141 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 130/256] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:41 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:42:41.743187 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8d94fd4b-5661-43b3-aeeb-a629b62187fa tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:41.743953 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-8d94fd4b-5661-43b3-aeeb-a629b62187fa tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: 5ae2e40f-2c92-4e19-8126-ba183bb7b14b] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:41.751153 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8d94fd4b-5661-43b3-aeeb-a629b62187fa tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:41.751981 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8d94fd4b-5661-43b3-aeeb-a629b62187fa tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:41.752976 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8d94fd4b-5661-43b3-aeeb-a629b62187fa tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:41.753432 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8d94fd4b-5661-43b3-aeeb-a629b62187fa tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:41.931709 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8d94fd4b-5661-43b3-aeeb-a629b62187fa tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:41.936746 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-a83110c4-af61-41cd-bb8c-1a9db033ba0d tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:41.937828 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-a83110c4-af61-41cd-bb8c-1a9db033ba0d tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:41.941003 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-8d94fd4b-5661-43b3-aeeb-a629b62187fa tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b" status: 200 len: 1318 microversion: 2.1 time: 0.202198 May 26 16:42:41.941615 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 127/257] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:41 2022] GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:41.949745 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a83110c4-af61-41cd-bb8c-1a9db033ba0d tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:41.950427 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a83110c4-af61-41cd-bb8c-1a9db033ba0d tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:41.951806 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a83110c4-af61-41cd-bb8c-1a9db033ba0d tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:41.952862 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a83110c4-af61-41cd-bb8c-1a9db033ba0d tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:41.979577 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.wsgi [None req-a83110c4-af61-41cd-bb8c-1a9db033ba0d tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] HTTP exception thrown: Instance 6bcd849c-2f03-44d0-9c4b-350431056dea could not be found. May 26 16:42:42.007943 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-a83110c4-af61-41cd-bb8c-1a9db033ba0d tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Request method failure captured: May 26 16:42:42.007943 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: request: GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea HTTP/1.1 May 26 16:42:42.007943 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept: application/json May 26 16:42:42.007943 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept-Encoding: identity May 26 16:42:42.007943 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Connection: close May 26 16:42:42.007943 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Length: 0 May 26 16:42:42.007943 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Type: application/json May 26 16:42:42.007943 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Host: 10.222.0.102 May 26 16:42:42.007943 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Openstack-System-Scope: None May 26 16:42:42.007943 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: User-Agent: python-urllib3/1.26.9 May 26 16:42:42.007943 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Auth-Token: gAAAAABij62bIbb4TCUTpb8NTq8hXox1EQHJGX5YNWwFQMbKgKgUT7tWXPKTlUDM1U0HvnWtesj1IVrdT4fkKC21rLNMDqvgeJXKRtiDezvlBdBXwHIj46tQArQA8-VdhpngHoRxztWbj7MBaHcUDtTWoIRTqWS0GWFdKJU6BozWHvtwDgG5FpM May 26 16:42:42.007943 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Id: None May 26 16:42:42.007943 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Name: None May 26 16:42:42.007943 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Identity-Status: Confirmed May 26 16:42:42.007943 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Is-Admin-Project: True May 26 16:42:42.007943 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Id: default May 26 16:42:42.007943 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Name: Default May 26 16:42:42.007943 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Id: 86b15e7956a347cba0b1dca0a45c8482 May 26 16:42:42.007943 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Name: tempest-DeleteServersTestJSON-1031107774 May 26 16:42:42.007943 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Role: reader,member May 26 16:42:42.007943 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Roles: reader,member May 26 16:42:42.010974 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/86b15e7956a347cba0b1dca0a45c8482"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/86b15e7956a347cba0b1dca0a45c8482"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/86b15e7956a347cba0b1dca0a45c8482"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_86b15e7956a347cba0b1dca0a45c8482"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:42:42.010974 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant: tempest-DeleteServersTestJSON-1031107774 May 26 16:42:42.010974 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Id: 86b15e7956a347cba0b1dca0a45c8482 May 26 16:42:42.010974 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Name: tempest-DeleteServersTestJSON-1031107774 May 26 16:42:42.010974 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User: tempest-DeleteServersTestJSON-1031107774-project May 26 16:42:42.010974 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Id: default May 26 16:42:42.010974 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Name: Default May 26 16:42:42.010974 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Id: 20b7990551ac458cb94c8bc922152650 May 26 16:42:42.010974 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Name: tempest-DeleteServersTestJSON-1031107774-project May 26 16:42:42.010974 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: method: > May 26 16:42:42.010974 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: exception: Instance 6bcd849c-2f03-44d0-9c4b-350431056dea could not be found. May 26 16:42:42.010974 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: action_args: {'id': '6bcd849c-2f03-44d0-9c4b-350431056dea'} May 26 16:42:42.012278 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:42:42.012278 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:42:42.012278 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:42:42.012278 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:42:42.012278 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:42:42.012278 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:42:42.012278 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:42:42.012278 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:42:42.012278 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:42:42.012278 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:42:42.012278 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bcd849c-2f03-44d0-9c4b-350431056dea could not be found. May 26 16:42:42.012278 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:42:42.012278 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:42:42.012278 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:42:42.012278 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:42:42.012278 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:42:42.012278 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:42:42.012278 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:42:42.012278 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:42:42.012278 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:42:42.014783 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:42:42.014783 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 16:42:42.014783 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 16:42:42.014783 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:42:42.014783 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:42:42.014783 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:42:42.014783 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:42:42.014783 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bcd849c-2f03-44d0-9c4b-350431056dea could not be found. May 26 16:42:42.014783 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:42:42.014783 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:42:42.014783 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:42:42.014783 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:42:42.014783 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:42:42.014783 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:42:42.014783 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:42:42.014783 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:42:42.014783 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bcd849c-2f03-44d0-9c4b-350431056dea could not be found. May 26 16:42:42.014783 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:42:42.016714 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-a83110c4-af61-41cd-bb8c-1a9db033ba0d tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Returning 404 to user: Instance 6bcd849c-2f03-44d0-9c4b-350431056dea could not be found. {{(pid=124267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:42:42.016714 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-a83110c4-af61-41cd-bb8c-1a9db033ba0d tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 404 len: 111 microversion: 2.1 time: 0.082780 May 26 16:42:42.016714 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 131/258] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:41 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 16:42:42.131136 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-79fee5f3-069b-48a2-b95b-7dd3b9251e38 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:42.132054 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-79fee5f3-069b-48a2-b95b-7dd3b9251e38 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:42.139701 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-79fee5f3-069b-48a2-b95b-7dd3b9251e38 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:42.140160 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-79fee5f3-069b-48a2-b95b-7dd3b9251e38 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:42.140991 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-79fee5f3-069b-48a2-b95b-7dd3b9251e38 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:42.141436 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-79fee5f3-069b-48a2-b95b-7dd3b9251e38 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:42.156555 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-79fee5f3-069b-48a2-b95b-7dd3b9251e38 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] HTTP exception thrown: Instance 6bcd849c-2f03-44d0-9c4b-350431056dea could not be found. May 26 16:42:42.160841 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-79fee5f3-069b-48a2-b95b-7dd3b9251e38 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Request method failure captured: May 26 16:42:42.160841 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea/os-volume_attachments HTTP/1.1 May 26 16:42:42.160841 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept: application/json May 26 16:42:42.160841 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity May 26 16:42:42.160841 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Connection: close May 26 16:42:42.160841 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Length: 0 May 26 16:42:42.160841 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Type: application/json May 26 16:42:42.160841 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Host: 10.222.0.102 May 26 16:42:42.160841 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None May 26 16:42:42.160841 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 May 26 16:42:42.160841 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABij62bIbb4TCUTpb8NTq8hXox1EQHJGX5YNWwFQMbKgKgUT7tWXPKTlUDM1U0HvnWtesj1IVrdT4fkKC21rLNMDqvgeJXKRtiDezvlBdBXwHIj46tQArQA8-VdhpngHoRxztWbj7MBaHcUDtTWoIRTqWS0GWFdKJU6BozWHvtwDgG5FpM May 26 16:42:42.160841 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Id: None May 26 16:42:42.160841 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Name: None May 26 16:42:42.160841 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed May 26 16:42:42.160841 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True May 26 16:42:42.160841 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default May 26 16:42:42.160841 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default May 26 16:42:42.160841 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Id: 86b15e7956a347cba0b1dca0a45c8482 May 26 16:42:42.160841 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-DeleteServersTestJSON-1031107774 May 26 16:42:42.160841 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Role: reader,member May 26 16:42:42.160841 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Roles: reader,member May 26 16:42:42.162235 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/86b15e7956a347cba0b1dca0a45c8482"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/86b15e7956a347cba0b1dca0a45c8482"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/86b15e7956a347cba0b1dca0a45c8482"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_86b15e7956a347cba0b1dca0a45c8482"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:42:42.162235 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-DeleteServersTestJSON-1031107774 May 26 16:42:42.162235 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Id: 86b15e7956a347cba0b1dca0a45c8482 May 26 16:42:42.162235 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-DeleteServersTestJSON-1031107774 May 26 16:42:42.162235 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User: tempest-DeleteServersTestJSON-1031107774-project May 26 16:42:42.162235 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default May 26 16:42:42.162235 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default May 26 16:42:42.162235 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Id: 20b7990551ac458cb94c8bc922152650 May 26 16:42:42.162235 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-DeleteServersTestJSON-1031107774-project May 26 16:42:42.162235 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: method: > May 26 16:42:42.162235 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: exception: Instance 6bcd849c-2f03-44d0-9c4b-350431056dea could not be found. May 26 16:42:42.162235 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: action_args: {'server_id': '6bcd849c-2f03-44d0-9c4b-350431056dea'} May 26 16:42:42.162870 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:42:42.162870 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:42:42.162870 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:42:42.162870 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:42:42.162870 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:42:42.162870 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:42:42.162870 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:42:42.162870 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:42:42.162870 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:42:42.162870 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:42:42.162870 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bcd849c-2f03-44d0-9c4b-350431056dea could not be found. May 26 16:42:42.162870 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:42:42.162870 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:42:42.162870 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:42:42.162870 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:42:42.162870 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:42:42.162870 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:42:42.162870 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:42:42.162870 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:42:42.162870 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:42:42.164805 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:42:42.164805 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 26 16:42:42.164805 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 16:42:42.164805 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 26 16:42:42.164805 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 16:42:42.164805 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 26 16:42:42.164805 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 26 16:42:42.164805 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:42:42.164805 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:42:42.164805 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bcd849c-2f03-44d0-9c4b-350431056dea could not be found. May 26 16:42:42.164805 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:42:42.164805 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:42:42.164805 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:42:42.164805 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:42:42.164805 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:42:42.164805 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:42:42.164805 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:42:42.164805 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:42:42.164805 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bcd849c-2f03-44d0-9c4b-350431056dea could not be found. May 26 16:42:42.164805 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:42:42.166941 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-79fee5f3-069b-48a2-b95b-7dd3b9251e38 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Returning 404 to user: Instance 6bcd849c-2f03-44d0-9c4b-350431056dea could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:42:42.166941 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-79fee5f3-069b-48a2-b95b-7dd3b9251e38 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035494 May 26 16:42:42.166941 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 128/259] 10.222.0.102 () {58 vars in 1306 bytes} [Thu May 26 16:42:42 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 16:42:42.666400 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-d3c0f3d1-658b-42e4-8673-865e7c27e2ac tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:42.668791 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-d3c0f3d1-658b-42e4-8673-865e7c27e2ac tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:42.683686 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d3c0f3d1-658b-42e4-8673-865e7c27e2ac tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:42.684538 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d3c0f3d1-658b-42e4-8673-865e7c27e2ac tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:42.686488 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d3c0f3d1-658b-42e4-8673-865e7c27e2ac tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:42.687461 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d3c0f3d1-658b-42e4-8673-865e7c27e2ac tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:42.903390 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-d3c0f3d1-658b-42e4-8673-865e7c27e2ac tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:42.918409 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-d3c0f3d1-658b-42e4-8673-865e7c27e2ac tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.262142 May 26 16:42:42.919498 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 132/260] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:42 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:42.961377 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-29cc08f0-3406-49a2-beb7-050140bb8c1f tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:42.962087 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-29cc08f0-3406-49a2-beb7-050140bb8c1f tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: 5ae2e40f-2c92-4e19-8126-ba183bb7b14b] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:42.969300 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-29cc08f0-3406-49a2-beb7-050140bb8c1f tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:42.969828 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-29cc08f0-3406-49a2-beb7-050140bb8c1f tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:42.970640 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-29cc08f0-3406-49a2-beb7-050140bb8c1f tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:42.971239 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-29cc08f0-3406-49a2-beb7-050140bb8c1f tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:42.989070 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=100 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:43.142007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-29cc08f0-3406-49a2-beb7-050140bb8c1f tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:43.152645 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-29cc08f0-3406-49a2-beb7-050140bb8c1f tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b" status: 200 len: 1318 microversion: 2.1 time: 0.195332 May 26 16:42:43.153456 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 129/261] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:42 2022] GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:42:43.413389 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-6449471a-51e8-4932-8772-30d65603e235 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:43.413983 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-6449471a-51e8-4932-8772-30d65603e235 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:43.422327 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-6449471a-51e8-4932-8772-30d65603e235 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:43.422955 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-6449471a-51e8-4932-8772-30d65603e235 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:43.423853 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-6449471a-51e8-4932-8772-30d65603e235 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:43.424359 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-6449471a-51e8-4932-8772-30d65603e235 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:43.444972 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.wsgi [None req-6449471a-51e8-4932-8772-30d65603e235 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] HTTP exception thrown: Instance 6bcd849c-2f03-44d0-9c4b-350431056dea could not be found. May 26 16:42:43.447280 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-6449471a-51e8-4932-8772-30d65603e235 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Request method failure captured: May 26 16:42:43.447280 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: request: DELETE /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea HTTP/1.1 May 26 16:42:43.447280 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept: application/json May 26 16:42:43.447280 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept-Encoding: identity May 26 16:42:43.447280 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Connection: close May 26 16:42:43.447280 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Length: 0 May 26 16:42:43.447280 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Type: application/json May 26 16:42:43.447280 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Host: 10.222.0.102 May 26 16:42:43.447280 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Openstack-System-Scope: None May 26 16:42:43.447280 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: User-Agent: python-urllib3/1.26.9 May 26 16:42:43.447280 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Auth-Token: gAAAAABij62bIbb4TCUTpb8NTq8hXox1EQHJGX5YNWwFQMbKgKgUT7tWXPKTlUDM1U0HvnWtesj1IVrdT4fkKC21rLNMDqvgeJXKRtiDezvlBdBXwHIj46tQArQA8-VdhpngHoRxztWbj7MBaHcUDtTWoIRTqWS0GWFdKJU6BozWHvtwDgG5FpM May 26 16:42:43.447280 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Id: None May 26 16:42:43.447280 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Name: None May 26 16:42:43.447280 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Identity-Status: Confirmed May 26 16:42:43.447280 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Is-Admin-Project: True May 26 16:42:43.447280 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Id: default May 26 16:42:43.447280 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Name: Default May 26 16:42:43.447280 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Id: 86b15e7956a347cba0b1dca0a45c8482 May 26 16:42:43.447280 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Name: tempest-DeleteServersTestJSON-1031107774 May 26 16:42:43.447280 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Role: reader,member May 26 16:42:43.447280 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Roles: reader,member May 26 16:42:43.449486 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/86b15e7956a347cba0b1dca0a45c8482"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/86b15e7956a347cba0b1dca0a45c8482"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/86b15e7956a347cba0b1dca0a45c8482"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_86b15e7956a347cba0b1dca0a45c8482"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:42:43.449486 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant: tempest-DeleteServersTestJSON-1031107774 May 26 16:42:43.449486 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Id: 86b15e7956a347cba0b1dca0a45c8482 May 26 16:42:43.449486 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Name: tempest-DeleteServersTestJSON-1031107774 May 26 16:42:43.449486 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User: tempest-DeleteServersTestJSON-1031107774-project May 26 16:42:43.449486 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Id: default May 26 16:42:43.449486 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Name: Default May 26 16:42:43.449486 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Id: 20b7990551ac458cb94c8bc922152650 May 26 16:42:43.449486 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Name: tempest-DeleteServersTestJSON-1031107774-project May 26 16:42:43.449486 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: method: > May 26 16:42:43.449486 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: exception: Instance 6bcd849c-2f03-44d0-9c4b-350431056dea could not be found. May 26 16:42:43.449486 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: action_args: {'id': '6bcd849c-2f03-44d0-9c4b-350431056dea'} May 26 16:42:43.450777 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:42:43.450777 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:42:43.450777 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:42:43.450777 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:42:43.450777 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:42:43.450777 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:42:43.450777 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:42:43.450777 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:42:43.450777 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:42:43.450777 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:42:43.450777 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bcd849c-2f03-44d0-9c4b-350431056dea could not be found. May 26 16:42:43.450777 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:42:43.450777 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:42:43.450777 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:42:43.450777 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:42:43.450777 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:42:43.450777 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:42:43.450777 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:42:43.450777 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:42:43.450777 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:42:43.452432 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:42:43.452432 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 16:42:43.452432 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 16:42:43.452432 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 16:42:43.452432 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 16:42:43.452432 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:42:43.452432 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:42:43.452432 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:42:43.452432 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:42:43.452432 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bcd849c-2f03-44d0-9c4b-350431056dea could not be found. May 26 16:42:43.452432 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:42:43.452432 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:42:43.452432 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:42:43.452432 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:42:43.452432 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:42:43.452432 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:42:43.452432 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:42:43.452432 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:42:43.452432 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bcd849c-2f03-44d0-9c4b-350431056dea could not be found. May 26 16:42:43.452432 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:42:43.453967 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-6449471a-51e8-4932-8772-30d65603e235 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Returning 404 to user: Instance 6bcd849c-2f03-44d0-9c4b-350431056dea could not be found. {{(pid=124267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:42:43.453967 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-6449471a-51e8-4932-8772-30d65603e235 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "DELETE /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 404 len: 111 microversion: 2.1 time: 0.040970 May 26 16:42:43.453967 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 133/262] 10.222.0.102 () {58 vars in 1243 bytes} [Thu May 26 16:42:43 2022] DELETE /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 16:42:43.464143 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-5ab0fcd8-e8b2-4c51-b500-e1f5f3caf0c4 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:43.465338 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-5ab0fcd8-e8b2-4c51-b500-e1f5f3caf0c4 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] [instance: 6bcd849c-2f03-44d0-9c4b-350431056dea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:43.476297 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5ab0fcd8-e8b2-4c51-b500-e1f5f3caf0c4 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:43.477103 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5ab0fcd8-e8b2-4c51-b500-e1f5f3caf0c4 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:43.479037 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5ab0fcd8-e8b2-4c51-b500-e1f5f3caf0c4 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:43.479853 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5ab0fcd8-e8b2-4c51-b500-e1f5f3caf0c4 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:43.506325 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-5ab0fcd8-e8b2-4c51-b500-e1f5f3caf0c4 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] HTTP exception thrown: Instance 6bcd849c-2f03-44d0-9c4b-350431056dea could not be found. May 26 16:42:43.510559 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-5ab0fcd8-e8b2-4c51-b500-e1f5f3caf0c4 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Request method failure captured: May 26 16:42:43.510559 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea HTTP/1.1 May 26 16:42:43.510559 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept: application/json May 26 16:42:43.510559 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity May 26 16:42:43.510559 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Connection: close May 26 16:42:43.510559 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Length: 0 May 26 16:42:43.510559 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Type: application/json May 26 16:42:43.510559 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Host: 10.222.0.102 May 26 16:42:43.510559 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None May 26 16:42:43.510559 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 May 26 16:42:43.510559 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABij62bIbb4TCUTpb8NTq8hXox1EQHJGX5YNWwFQMbKgKgUT7tWXPKTlUDM1U0HvnWtesj1IVrdT4fkKC21rLNMDqvgeJXKRtiDezvlBdBXwHIj46tQArQA8-VdhpngHoRxztWbj7MBaHcUDtTWoIRTqWS0GWFdKJU6BozWHvtwDgG5FpM May 26 16:42:43.510559 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Id: None May 26 16:42:43.510559 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Name: None May 26 16:42:43.510559 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed May 26 16:42:43.510559 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True May 26 16:42:43.510559 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default May 26 16:42:43.510559 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default May 26 16:42:43.510559 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Id: 86b15e7956a347cba0b1dca0a45c8482 May 26 16:42:43.510559 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-DeleteServersTestJSON-1031107774 May 26 16:42:43.510559 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Role: reader,member May 26 16:42:43.510559 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Roles: reader,member May 26 16:42:43.511925 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/86b15e7956a347cba0b1dca0a45c8482"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/86b15e7956a347cba0b1dca0a45c8482"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/86b15e7956a347cba0b1dca0a45c8482"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_86b15e7956a347cba0b1dca0a45c8482"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:42:43.511925 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-DeleteServersTestJSON-1031107774 May 26 16:42:43.511925 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Id: 86b15e7956a347cba0b1dca0a45c8482 May 26 16:42:43.511925 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-DeleteServersTestJSON-1031107774 May 26 16:42:43.511925 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User: tempest-DeleteServersTestJSON-1031107774-project May 26 16:42:43.511925 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default May 26 16:42:43.511925 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default May 26 16:42:43.511925 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Id: 20b7990551ac458cb94c8bc922152650 May 26 16:42:43.511925 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-DeleteServersTestJSON-1031107774-project May 26 16:42:43.511925 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: method: > May 26 16:42:43.511925 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: exception: Instance 6bcd849c-2f03-44d0-9c4b-350431056dea could not be found. May 26 16:42:43.511925 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: action_args: {'id': '6bcd849c-2f03-44d0-9c4b-350431056dea'} May 26 16:42:43.512702 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:42:43.512702 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:42:43.512702 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:42:43.512702 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:42:43.512702 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:42:43.512702 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:42:43.512702 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:42:43.512702 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:42:43.512702 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:42:43.512702 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:42:43.512702 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bcd849c-2f03-44d0-9c4b-350431056dea could not be found. May 26 16:42:43.512702 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:42:43.512702 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:42:43.512702 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:42:43.512702 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:42:43.512702 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:42:43.512702 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:42:43.512702 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:42:43.512702 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:42:43.512702 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:42:43.513881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:42:43.513881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 16:42:43.513881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 16:42:43.513881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:42:43.513881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:42:43.513881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:42:43.513881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:42:43.513881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bcd849c-2f03-44d0-9c4b-350431056dea could not be found. May 26 16:42:43.513881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:42:43.513881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:42:43.513881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:42:43.513881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:42:43.513881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:42:43.513881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:42:43.513881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:42:43.513881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:42:43.513881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bcd849c-2f03-44d0-9c4b-350431056dea could not be found. May 26 16:42:43.513881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:42:43.515235 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-5ab0fcd8-e8b2-4c51-b500-e1f5f3caf0c4 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] Returning 404 to user: Instance 6bcd849c-2f03-44d0-9c4b-350431056dea could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:42:43.515235 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-5ab0fcd8-e8b2-4c51-b500-e1f5f3caf0c4 tempest-DeleteServersTestJSON-1031107774 tempest-DeleteServersTestJSON-1031107774-project] 10.222.0.102 "GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea" status: 404 len: 111 microversion: 2.1 time: 0.056232 May 26 16:42:43.515235 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 130/263] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:43 2022] GET /compute/v2.1/servers/6bcd849c-2f03-44d0-9c4b-350431056dea => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 16:42:43.940308 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-07f1e216-4986-4419-9eae-0c6f6a1e4a1e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:43.942044 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-07f1e216-4986-4419-9eae-0c6f6a1e4a1e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:43.951104 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-07f1e216-4986-4419-9eae-0c6f6a1e4a1e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:43.952458 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-07f1e216-4986-4419-9eae-0c6f6a1e4a1e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:43.953860 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-07f1e216-4986-4419-9eae-0c6f6a1e4a1e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:43.954487 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-07f1e216-4986-4419-9eae-0c6f6a1e4a1e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:44.180933 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1ab0bbd4-6659-4024-ba9f-d9923c64a042 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:44.182970 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1ab0bbd4-6659-4024-ba9f-d9923c64a042 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: 5ae2e40f-2c92-4e19-8126-ba183bb7b14b] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:44.204502 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:44.209169 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=6 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:44.215119 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1ab0bbd4-6659-4024-ba9f-d9923c64a042 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:44.216776 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1ab0bbd4-6659-4024-ba9f-d9923c64a042 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:44.219445 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1ab0bbd4-6659-4024-ba9f-d9923c64a042 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:44.220746 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1ab0bbd4-6659-4024-ba9f-d9923c64a042 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:44.279713 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell0:SELECT=2 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:44.674717 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-07f1e216-4986-4419-9eae-0c6f6a1e4a1e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:44.703306 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-07f1e216-4986-4419-9eae-0c6f6a1e4a1e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.768327 May 26 16:42:44.728532 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 134/264] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:43 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:42:44.906936 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1ab0bbd4-6659-4024-ba9f-d9923c64a042 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:44.921267 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1ab0bbd4-6659-4024-ba9f-d9923c64a042 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b" status: 200 len: 1318 microversion: 2.1 time: 0.746956 May 26 16:42:44.934136 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 131/265] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:44 2022] GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b => generated 1318 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:45.755926 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-00f6fbfc-bc2e-4b53-871b-0fe7235558b4 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:45.763796 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-00f6fbfc-bc2e-4b53-871b-0fe7235558b4 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:45.787078 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-00f6fbfc-bc2e-4b53-871b-0fe7235558b4 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:45.797361 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-00f6fbfc-bc2e-4b53-871b-0fe7235558b4 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:45.798938 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-00f6fbfc-bc2e-4b53-871b-0fe7235558b4 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:45.806449 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-00f6fbfc-bc2e-4b53-871b-0fe7235558b4 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:45.958515 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-20f46f1b-539d-4c17-ae85-dd5f3d62bdd7 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:45.959595 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-20f46f1b-539d-4c17-ae85-dd5f3d62bdd7 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: 5ae2e40f-2c92-4e19-8126-ba183bb7b14b] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:45.979762 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-20f46f1b-539d-4c17-ae85-dd5f3d62bdd7 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:45.980643 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-20f46f1b-539d-4c17-ae85-dd5f3d62bdd7 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:45.981755 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-20f46f1b-539d-4c17-ae85-dd5f3d62bdd7 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:45.982422 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-20f46f1b-539d-4c17-ae85-dd5f3d62bdd7 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:46.232562 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-00f6fbfc-bc2e-4b53-871b-0fe7235558b4 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:46.241925 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-00f6fbfc-bc2e-4b53-871b-0fe7235558b4 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.496066 May 26 16:42:46.242550 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 135/266] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:45 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:46.274752 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-20f46f1b-539d-4c17-ae85-dd5f3d62bdd7 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:46.300280 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-20f46f1b-539d-4c17-ae85-dd5f3d62bdd7 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b" status: 200 len: 1318 microversion: 2.1 time: 0.358199 May 26 16:42:46.300938 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 132/267] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:45 2022] GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b => generated 1318 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:47.269046 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-e4ee3597-f3fe-4cf4-94b8-43d138616867 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:47.279918 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-e4ee3597-f3fe-4cf4-94b8-43d138616867 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:47.295074 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e4ee3597-f3fe-4cf4-94b8-43d138616867 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:47.295789 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e4ee3597-f3fe-4cf4-94b8-43d138616867 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:47.296781 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e4ee3597-f3fe-4cf4-94b8-43d138616867 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:47.297332 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e4ee3597-f3fe-4cf4-94b8-43d138616867 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:47.327546 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ac323eaa-9023-4b15-8f42-05c26b944ba9 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:47.329273 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ac323eaa-9023-4b15-8f42-05c26b944ba9 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: 5ae2e40f-2c92-4e19-8126-ba183bb7b14b] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:47.336217 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ac323eaa-9023-4b15-8f42-05c26b944ba9 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:47.337787 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ac323eaa-9023-4b15-8f42-05c26b944ba9 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:47.338603 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ac323eaa-9023-4b15-8f42-05c26b944ba9 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:47.339241 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ac323eaa-9023-4b15-8f42-05c26b944ba9 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:47.627354 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-e4ee3597-f3fe-4cf4-94b8-43d138616867 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:47.653608 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-e4ee3597-f3fe-4cf4-94b8-43d138616867 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.392458 May 26 16:42:47.668666 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 136/268] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:47 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:47.734950 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ac323eaa-9023-4b15-8f42-05c26b944ba9 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:47.748403 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ac323eaa-9023-4b15-8f42-05c26b944ba9 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b" status: 200 len: 1318 microversion: 2.1 time: 0.425881 May 26 16:42:47.749087 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 133/269] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:47 2022] GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b => generated 1318 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:48.686690 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-f49d14b3-58e4-4a1e-b4cd-8d02bd281ff7 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:48.687848 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-f49d14b3-58e4-4a1e-b4cd-8d02bd281ff7 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:48.698347 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f49d14b3-58e4-4a1e-b4cd-8d02bd281ff7 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:48.699294 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f49d14b3-58e4-4a1e-b4cd-8d02bd281ff7 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:48.700260 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f49d14b3-58e4-4a1e-b4cd-8d02bd281ff7 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:48.700835 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f49d14b3-58e4-4a1e-b4cd-8d02bd281ff7 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:48.770482 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0975c6e0-ac1c-4578-94fc-18473d65800e tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:48.771614 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0975c6e0-ac1c-4578-94fc-18473d65800e tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: 5ae2e40f-2c92-4e19-8126-ba183bb7b14b] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:48.784534 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0975c6e0-ac1c-4578-94fc-18473d65800e tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:48.785423 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0975c6e0-ac1c-4578-94fc-18473d65800e tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:48.787177 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0975c6e0-ac1c-4578-94fc-18473d65800e tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:48.788209 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0975c6e0-ac1c-4578-94fc-18473d65800e tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:49.117441 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-f49d14b3-58e4-4a1e-b4cd-8d02bd281ff7 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:49.126489 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-f49d14b3-58e4-4a1e-b4cd-8d02bd281ff7 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.447936 May 26 16:42:49.127388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 137/270] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:48 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:49.128924 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0975c6e0-ac1c-4578-94fc-18473d65800e tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:49.143006 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0975c6e0-ac1c-4578-94fc-18473d65800e tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b" status: 200 len: 1318 microversion: 2.1 time: 0.379866 May 26 16:42:49.144286 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 134/271] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:48 2022] GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b => generated 1318 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:49.897258 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-c5f8dcf5-0af4-4f38-bd10-0f6c1f0ce799 req-a1979cba-4cb2-4efc-bf0b-17bc4e69832b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ae2e40f-2c92-4e19-8126-ba183bb7b14b", "name": "network-vif-plugged", "status": "completed", "tag": "f23e1dc1-523f-4d3b-8009-7b28b75b6bcd"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:42:49.915864 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-c5f8dcf5-0af4-4f38-bd10-0f6c1f0ce799 req-a1979cba-4cb2-4efc-bf0b-17bc4e69832b service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:49.917412 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-c5f8dcf5-0af4-4f38-bd10-0f6c1f0ce799 req-a1979cba-4cb2-4efc-bf0b-17bc4e69832b service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:49.951096 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-c5f8dcf5-0af4-4f38-bd10-0f6c1f0ce799 req-a1979cba-4cb2-4efc-bf0b-17bc4e69832b service nova] Creating event network-vif-plugged:f23e1dc1-523f-4d3b-8009-7b28b75b6bcd for instance 5ae2e40f-2c92-4e19-8126-ba183bb7b14b on hv-cinder-83607 May 26 16:42:49.959937 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-c5f8dcf5-0af4-4f38-bd10-0f6c1f0ce799 req-a1979cba-4cb2-4efc-bf0b-17bc4e69832b service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070195 May 26 16:42:49.961348 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 138/272] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:42:50.147786 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e1baf5dc-bc92-4fc2-a6fd-61927636e2de tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:50.149585 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e1baf5dc-bc92-4fc2-a6fd-61927636e2de tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:50.160167 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e1baf5dc-bc92-4fc2-a6fd-61927636e2de tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:50.160834 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e1baf5dc-bc92-4fc2-a6fd-61927636e2de tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:50.161768 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e1baf5dc-bc92-4fc2-a6fd-61927636e2de tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:50.164636 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e1baf5dc-bc92-4fc2-a6fd-61927636e2de tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:50.172127 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-8ceb9cfd-b8d1-47ac-a3bf-e2054a322f15 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:50.173585 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-8ceb9cfd-b8d1-47ac-a3bf-e2054a322f15 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: 5ae2e40f-2c92-4e19-8126-ba183bb7b14b] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:50.185913 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8ceb9cfd-b8d1-47ac-a3bf-e2054a322f15 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:50.186389 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8ceb9cfd-b8d1-47ac-a3bf-e2054a322f15 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:50.188627 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8ceb9cfd-b8d1-47ac-a3bf-e2054a322f15 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:50.189019 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8ceb9cfd-b8d1-47ac-a3bf-e2054a322f15 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:50.533625 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e1baf5dc-bc92-4fc2-a6fd-61927636e2de tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:50.540495 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-8ceb9cfd-b8d1-47ac-a3bf-e2054a322f15 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:50.548026 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e1baf5dc-bc92-4fc2-a6fd-61927636e2de tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.407622 May 26 16:42:50.548918 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 135/273] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:50 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:50.552275 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-8ceb9cfd-b8d1-47ac-a3bf-e2054a322f15 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b" status: 200 len: 1318 microversion: 2.1 time: 0.385222 May 26 16:42:50.552922 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 139/274] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:50 2022] GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b => generated 1318 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:42:51.570362 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2ded0d81-dc43-49f5-a3d5-93d36a5d69cc tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:51.571305 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-c68a275c-2e3d-44e5-8c5a-a8de7e4f1565 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:51.571956 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-c68a275c-2e3d-44e5-8c5a-a8de7e4f1565 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: 5ae2e40f-2c92-4e19-8126-ba183bb7b14b] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:51.572340 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2ded0d81-dc43-49f5-a3d5-93d36a5d69cc tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:51.578696 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c68a275c-2e3d-44e5-8c5a-a8de7e4f1565 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:51.579234 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c68a275c-2e3d-44e5-8c5a-a8de7e4f1565 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:51.580032 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c68a275c-2e3d-44e5-8c5a-a8de7e4f1565 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:51.580479 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c68a275c-2e3d-44e5-8c5a-a8de7e4f1565 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:51.583165 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2ded0d81-dc43-49f5-a3d5-93d36a5d69cc tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:51.584041 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2ded0d81-dc43-49f5-a3d5-93d36a5d69cc tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:51.585190 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2ded0d81-dc43-49f5-a3d5-93d36a5d69cc tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:51.588195 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2ded0d81-dc43-49f5-a3d5-93d36a5d69cc tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:51.826527 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-c68a275c-2e3d-44e5-8c5a-a8de7e4f1565 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:51.841365 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-c68a275c-2e3d-44e5-8c5a-a8de7e4f1565 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b" status: 200 len: 1318 microversion: 2.1 time: 0.274222 May 26 16:42:51.842648 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 140/275] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:51 2022] GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:51.845451 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-2ded0d81-dc43-49f5-a3d5-93d36a5d69cc tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:51.859933 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2ded0d81-dc43-49f5-a3d5-93d36a5d69cc tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.294500 May 26 16:42:51.860945 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 136/276] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:51 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:52.861451 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-090cab72-ab22-4e2e-8c78-869d71fe69b8 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:52.862301 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-090cab72-ab22-4e2e-8c78-869d71fe69b8 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: 5ae2e40f-2c92-4e19-8126-ba183bb7b14b] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:52.872297 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-090cab72-ab22-4e2e-8c78-869d71fe69b8 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:52.872875 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-090cab72-ab22-4e2e-8c78-869d71fe69b8 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:52.873886 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-090cab72-ab22-4e2e-8c78-869d71fe69b8 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:52.874456 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-090cab72-ab22-4e2e-8c78-869d71fe69b8 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:52.889099 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2eb1d782-89d5-49c8-9122-04d5357f9451 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:52.890638 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2eb1d782-89d5-49c8-9122-04d5357f9451 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:52.903032 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2eb1d782-89d5-49c8-9122-04d5357f9451 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:52.903862 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2eb1d782-89d5-49c8-9122-04d5357f9451 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:52.905214 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2eb1d782-89d5-49c8-9122-04d5357f9451 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:52.906062 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2eb1d782-89d5-49c8-9122-04d5357f9451 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:53.110757 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-090cab72-ab22-4e2e-8c78-869d71fe69b8 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:53.131320 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-090cab72-ab22-4e2e-8c78-869d71fe69b8 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b" status: 200 len: 1501 microversion: 2.1 time: 0.272958 May 26 16:42:53.134195 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 141/277] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:52 2022] GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b => generated 1501 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:53.156231 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-2eb1d782-89d5-49c8-9122-04d5357f9451 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:53.165633 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2eb1d782-89d5-49c8-9122-04d5357f9451 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.282717 May 26 16:42:53.166488 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 137/278] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:52 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:54.184241 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-20eadc5a-30c5-4e2a-956e-1e35f01f6c94 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:54.184903 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-20eadc5a-30c5-4e2a-956e-1e35f01f6c94 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:54.191482 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-20eadc5a-30c5-4e2a-956e-1e35f01f6c94 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:54.191945 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-20eadc5a-30c5-4e2a-956e-1e35f01f6c94 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:54.192770 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-20eadc5a-30c5-4e2a-956e-1e35f01f6c94 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:54.193587 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-20eadc5a-30c5-4e2a-956e-1e35f01f6c94 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:54.373592 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-20eadc5a-30c5-4e2a-956e-1e35f01f6c94 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:54.384725 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-20eadc5a-30c5-4e2a-956e-1e35f01f6c94 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.204635 May 26 16:42:54.385473 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 142/279] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:54 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:55.403386 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9a381d69-2e17-419a-81fb-6cce6a608dcd tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:55.404328 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9a381d69-2e17-419a-81fb-6cce6a608dcd tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:55.411875 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9a381d69-2e17-419a-81fb-6cce6a608dcd tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:55.412648 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9a381d69-2e17-419a-81fb-6cce6a608dcd tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:55.413687 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9a381d69-2e17-419a-81fb-6cce6a608dcd tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:55.414241 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9a381d69-2e17-419a-81fb-6cce6a608dcd tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:55.575677 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9a381d69-2e17-419a-81fb-6cce6a608dcd tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:55.595851 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9a381d69-2e17-419a-81fb-6cce6a608dcd tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.196360 May 26 16:42:55.596799 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 138/280] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:55 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:56.621814 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-7333a2d7-32e0-41e7-8fc5-d0024240364f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:56.622913 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-7333a2d7-32e0-41e7-8fc5-d0024240364f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:56.633268 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7333a2d7-32e0-41e7-8fc5-d0024240364f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:56.634551 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7333a2d7-32e0-41e7-8fc5-d0024240364f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:56.635904 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7333a2d7-32e0-41e7-8fc5-d0024240364f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:56.636716 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7333a2d7-32e0-41e7-8fc5-d0024240364f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:57.069593 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-7333a2d7-32e0-41e7-8fc5-d0024240364f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:57.080252 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-7333a2d7-32e0-41e7-8fc5-d0024240364f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.464399 May 26 16:42:57.081180 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 143/281] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:56 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:58.105375 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-01212507-4b78-4606-b40e-65594d954b9d tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:58.107105 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-01212507-4b78-4606-b40e-65594d954b9d tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:58.116740 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-01212507-4b78-4606-b40e-65594d954b9d tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:58.117779 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-01212507-4b78-4606-b40e-65594d954b9d tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:58.118991 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-01212507-4b78-4606-b40e-65594d954b9d tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:58.120079 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-01212507-4b78-4606-b40e-65594d954b9d tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:58.347632 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-01212507-4b78-4606-b40e-65594d954b9d tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:58.361759 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-01212507-4b78-4606-b40e-65594d954b9d tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.262908 May 26 16:42:58.362794 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 139/282] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:58 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:59.380228 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-9d47a86b-0241-4a62-8903-328691879e64 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:59.381090 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-9d47a86b-0241-4a62-8903-328691879e64 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:59.388516 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9d47a86b-0241-4a62-8903-328691879e64 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:59.389003 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9d47a86b-0241-4a62-8903-328691879e64 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:59.389764 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9d47a86b-0241-4a62-8903-328691879e64 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:59.390393 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9d47a86b-0241-4a62-8903-328691879e64 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:59.578464 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-9d47a86b-0241-4a62-8903-328691879e64 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:42:59.582630 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=100 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:59.596561 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-9d47a86b-0241-4a62-8903-328691879e64 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.220030 May 26 16:42:59.597767 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 144/283] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:59 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:42:59.628754 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3550affe-bc4d-49fe-aaae-b40c862ff21a tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:59.629660 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-3550affe-bc4d-49fe-aaae-b40c862ff21a tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: 5ae2e40f-2c92-4e19-8126-ba183bb7b14b] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:59.640121 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3550affe-bc4d-49fe-aaae-b40c862ff21a tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:59.640577 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3550affe-bc4d-49fe-aaae-b40c862ff21a tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:59.641659 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3550affe-bc4d-49fe-aaae-b40c862ff21a tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:59.642117 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3550affe-bc4d-49fe-aaae-b40c862ff21a tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:59.673850 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-3550affe-bc4d-49fe-aaae-b40c862ff21a tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: 5ae2e40f-2c92-4e19-8126-ba183bb7b14b] Going to try to terminate instance {{(pid=124266) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 16:42:59.796017 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-3550affe-bc4d-49fe-aaae-b40c862ff21a tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "DELETE /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b" status: 204 len: 0 microversion: 2.1 time: 0.173318 May 26 16:42:59.801025 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 140/284] 10.222.0.102 () {58 vars in 1243 bytes} [Thu May 26 16:42:59 2022] DELETE /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 16:42:59.807847 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-40627fe9-679c-4899-9ab3-29fa0ec1e656 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:42:59.808962 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-40627fe9-679c-4899-9ab3-29fa0ec1e656 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: 5ae2e40f-2c92-4e19-8126-ba183bb7b14b] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:42:59.816029 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-40627fe9-679c-4899-9ab3-29fa0ec1e656 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:59.816893 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-40627fe9-679c-4899-9ab3-29fa0ec1e656 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:42:59.817730 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-40627fe9-679c-4899-9ab3-29fa0ec1e656 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:42:59.818206 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-40627fe9-679c-4899-9ab3-29fa0ec1e656 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:00.041215 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-40627fe9-679c-4899-9ab3-29fa0ec1e656 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:00.052998 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-40627fe9-679c-4899-9ab3-29fa0ec1e656 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b" status: 200 len: 1507 microversion: 2.1 time: 0.250306 May 26 16:43:00.054664 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 145/285] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:42:59 2022] GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b => generated 1507 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:00.629446 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-5950f374-efa8-4b56-af4d-b2fade676373 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:00.631286 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-5950f374-efa8-4b56-af4d-b2fade676373 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:00.644262 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5950f374-efa8-4b56-af4d-b2fade676373 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:00.645048 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5950f374-efa8-4b56-af4d-b2fade676373 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:00.646427 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5950f374-efa8-4b56-af4d-b2fade676373 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:00.647214 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5950f374-efa8-4b56-af4d-b2fade676373 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:00.823398 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-5950f374-efa8-4b56-af4d-b2fade676373 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:00.832131 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-5950f374-efa8-4b56-af4d-b2fade676373 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.211022 May 26 16:43:00.841403 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 141/286] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:00 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:01.074790 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-847f7b0c-be8f-4586-8f69-33656c0c4a88 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:01.075352 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-847f7b0c-be8f-4586-8f69-33656c0c4a88 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: 5ae2e40f-2c92-4e19-8126-ba183bb7b14b] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:01.082009 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-847f7b0c-be8f-4586-8f69-33656c0c4a88 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:01.082460 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-847f7b0c-be8f-4586-8f69-33656c0c4a88 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:01.083244 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-847f7b0c-be8f-4586-8f69-33656c0c4a88 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:01.083674 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-847f7b0c-be8f-4586-8f69-33656c0c4a88 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:01.286383 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-847f7b0c-be8f-4586-8f69-33656c0c4a88 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:01.300272 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-847f7b0c-be8f-4586-8f69-33656c0c4a88 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b" status: 200 len: 1507 microversion: 2.1 time: 0.232013 May 26 16:43:01.301400 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 146/287] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:01 2022] GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b => generated 1507 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:01.856614 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-25e31a54-78f7-49c9-a78b-4d6b2b811158 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:01.857596 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-25e31a54-78f7-49c9-a78b-4d6b2b811158 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:01.866042 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-25e31a54-78f7-49c9-a78b-4d6b2b811158 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:01.866718 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-25e31a54-78f7-49c9-a78b-4d6b2b811158 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:01.870026 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-25e31a54-78f7-49c9-a78b-4d6b2b811158 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:01.870026 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-25e31a54-78f7-49c9-a78b-4d6b2b811158 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:02.028975 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-25e31a54-78f7-49c9-a78b-4d6b2b811158 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:02.040144 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-25e31a54-78f7-49c9-a78b-4d6b2b811158 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.189748 May 26 16:43:02.040968 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 142/288] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:01 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:02.326199 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-8b929f06-81e6-4537-82ed-fcf5b1f03011 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:02.327369 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-8b929f06-81e6-4537-82ed-fcf5b1f03011 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: 5ae2e40f-2c92-4e19-8126-ba183bb7b14b] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:02.334605 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8b929f06-81e6-4537-82ed-fcf5b1f03011 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:02.335100 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8b929f06-81e6-4537-82ed-fcf5b1f03011 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:02.335921 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8b929f06-81e6-4537-82ed-fcf5b1f03011 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:02.336951 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8b929f06-81e6-4537-82ed-fcf5b1f03011 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:02.501620 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-8b929f06-81e6-4537-82ed-fcf5b1f03011 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:02.510779 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-8b929f06-81e6-4537-82ed-fcf5b1f03011 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b" status: 200 len: 1507 microversion: 2.1 time: 0.188590 May 26 16:43:02.511382 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 147/289] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:02 2022] GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b => generated 1507 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:03.060084 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-663fb5cc-5757-4824-bb55-24b2fee5e403 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:03.060978 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-663fb5cc-5757-4824-bb55-24b2fee5e403 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:03.065028 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:03.075550 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-663fb5cc-5757-4824-bb55-24b2fee5e403 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:03.076249 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-663fb5cc-5757-4824-bb55-24b2fee5e403 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:03.077535 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-663fb5cc-5757-4824-bb55-24b2fee5e403 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:03.078196 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-663fb5cc-5757-4824-bb55-24b2fee5e403 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:03.254890 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-663fb5cc-5757-4824-bb55-24b2fee5e403 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:03.269122 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-663fb5cc-5757-4824-bb55-24b2fee5e403 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.213304 May 26 16:43:03.270196 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 143/290] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:03 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:03.527414 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-49a8b317-74a3-4f72-8af9-1a0ee1397b83 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:03.528029 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-49a8b317-74a3-4f72-8af9-1a0ee1397b83 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: 5ae2e40f-2c92-4e19-8126-ba183bb7b14b] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:03.530110 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:03.535481 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-49a8b317-74a3-4f72-8af9-1a0ee1397b83 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:03.535931 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-49a8b317-74a3-4f72-8af9-1a0ee1397b83 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:03.536748 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-49a8b317-74a3-4f72-8af9-1a0ee1397b83 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:03.537188 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-49a8b317-74a3-4f72-8af9-1a0ee1397b83 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:03.678082 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-49a8b317-74a3-4f72-8af9-1a0ee1397b83 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:03.686133 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-49a8b317-74a3-4f72-8af9-1a0ee1397b83 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b" status: 200 len: 1507 microversion: 2.1 time: 0.162642 May 26 16:43:03.686716 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 148/291] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:03 2022] GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:04.293448 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8d07f603-b365-4ccf-9ea7-96dfc0628dd1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:04.294513 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-8d07f603-b365-4ccf-9ea7-96dfc0628dd1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:04.303231 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8d07f603-b365-4ccf-9ea7-96dfc0628dd1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:04.303763 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8d07f603-b365-4ccf-9ea7-96dfc0628dd1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:04.304793 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8d07f603-b365-4ccf-9ea7-96dfc0628dd1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:04.305391 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8d07f603-b365-4ccf-9ea7-96dfc0628dd1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:04.466561 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8d07f603-b365-4ccf-9ea7-96dfc0628dd1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:04.475680 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-8d07f603-b365-4ccf-9ea7-96dfc0628dd1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.188121 May 26 16:43:04.476287 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 144/292] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:04 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:04.705831 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-b3e3eb7a-830e-4a11-a848-f20588fdf4d3 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:04.706509 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-b3e3eb7a-830e-4a11-a848-f20588fdf4d3 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: 5ae2e40f-2c92-4e19-8126-ba183bb7b14b] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:04.716691 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b3e3eb7a-830e-4a11-a848-f20588fdf4d3 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:04.717267 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b3e3eb7a-830e-4a11-a848-f20588fdf4d3 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:04.718723 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b3e3eb7a-830e-4a11-a848-f20588fdf4d3 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:04.719334 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b3e3eb7a-830e-4a11-a848-f20588fdf4d3 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:04.883026 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-b3e3eb7a-830e-4a11-a848-f20588fdf4d3 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:04.892507 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-b3e3eb7a-830e-4a11-a848-f20588fdf4d3 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b" status: 200 len: 1507 microversion: 2.1 time: 0.190946 May 26 16:43:04.893359 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 149/293] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:04 2022] GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b => generated 1507 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:43:05.495080 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d20b53cd-572a-47ac-9e39-4864d701b3a0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:05.495721 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d20b53cd-572a-47ac-9e39-4864d701b3a0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:05.501873 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d20b53cd-572a-47ac-9e39-4864d701b3a0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:05.502322 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d20b53cd-572a-47ac-9e39-4864d701b3a0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:05.503089 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d20b53cd-572a-47ac-9e39-4864d701b3a0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:05.503523 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d20b53cd-572a-47ac-9e39-4864d701b3a0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:05.506182 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:05.663471 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d20b53cd-572a-47ac-9e39-4864d701b3a0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:05.672333 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d20b53cd-572a-47ac-9e39-4864d701b3a0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.181786 May 26 16:43:05.673813 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 145/294] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:05 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:05.914520 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-2f9a3ba5-a5c3-4f13-8c43-3baa0701c6e3 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:05.916278 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-2f9a3ba5-a5c3-4f13-8c43-3baa0701c6e3 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: 5ae2e40f-2c92-4e19-8126-ba183bb7b14b] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:05.925787 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2f9a3ba5-a5c3-4f13-8c43-3baa0701c6e3 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:05.926367 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2f9a3ba5-a5c3-4f13-8c43-3baa0701c6e3 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:05.927659 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2f9a3ba5-a5c3-4f13-8c43-3baa0701c6e3 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:05.928615 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2f9a3ba5-a5c3-4f13-8c43-3baa0701c6e3 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:06.202907 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-2f9a3ba5-a5c3-4f13-8c43-3baa0701c6e3 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:06.222832 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-2f9a3ba5-a5c3-4f13-8c43-3baa0701c6e3 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b" status: 200 len: 1507 microversion: 2.1 time: 0.315260 May 26 16:43:06.223694 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 150/295] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:05 2022] GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b => generated 1507 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:06.702528 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2bf48c30-aabc-45e0-8366-611d5db6d936 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:06.708801 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2bf48c30-aabc-45e0-8366-611d5db6d936 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:06.733547 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2bf48c30-aabc-45e0-8366-611d5db6d936 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:06.736832 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2bf48c30-aabc-45e0-8366-611d5db6d936 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:06.743907 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2bf48c30-aabc-45e0-8366-611d5db6d936 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:06.745043 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2bf48c30-aabc-45e0-8366-611d5db6d936 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:07.016984 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-2bf48c30-aabc-45e0-8366-611d5db6d936 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:07.026262 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2bf48c30-aabc-45e0-8366-611d5db6d936 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.337252 May 26 16:43:07.027007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 146/296] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:06 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:07.248524 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-2a9e9550-f8c9-4407-9729-a570c1871eb4 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:07.249107 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-2a9e9550-f8c9-4407-9729-a570c1871eb4 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: 5ae2e40f-2c92-4e19-8126-ba183bb7b14b] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:07.258101 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2a9e9550-f8c9-4407-9729-a570c1871eb4 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:07.259517 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2a9e9550-f8c9-4407-9729-a570c1871eb4 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:07.261313 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2a9e9550-f8c9-4407-9729-a570c1871eb4 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:07.262086 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2a9e9550-f8c9-4407-9729-a570c1871eb4 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:07.491706 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-2a9e9550-f8c9-4407-9729-a570c1871eb4 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:07.510830 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-2a9e9550-f8c9-4407-9729-a570c1871eb4 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b" status: 200 len: 1507 microversion: 2.1 time: 0.265968 May 26 16:43:07.511444 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 151/297] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:07 2022] GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b => generated 1507 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:08.044706 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-392c3827-a337-45e3-80c9-58e19a8cc05e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:08.046101 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-392c3827-a337-45e3-80c9-58e19a8cc05e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:08.053756 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-392c3827-a337-45e3-80c9-58e19a8cc05e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:08.054285 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-392c3827-a337-45e3-80c9-58e19a8cc05e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:08.054911 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-392c3827-a337-45e3-80c9-58e19a8cc05e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:08.056580 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-392c3827-a337-45e3-80c9-58e19a8cc05e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:08.233441 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-392c3827-a337-45e3-80c9-58e19a8cc05e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:08.252959 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-392c3827-a337-45e3-80c9-58e19a8cc05e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.212675 May 26 16:43:08.253937 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 147/298] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:08 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:08.530046 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-1f83cf88-2aec-40d8-84c8-897f07016dd3 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:08.530669 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-1f83cf88-2aec-40d8-84c8-897f07016dd3 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: 5ae2e40f-2c92-4e19-8126-ba183bb7b14b] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:08.537247 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1f83cf88-2aec-40d8-84c8-897f07016dd3 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:08.537704 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1f83cf88-2aec-40d8-84c8-897f07016dd3 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:08.538482 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1f83cf88-2aec-40d8-84c8-897f07016dd3 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:08.538923 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1f83cf88-2aec-40d8-84c8-897f07016dd3 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:08.685844 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-1f83cf88-2aec-40d8-84c8-897f07016dd3 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:08.697746 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-1f83cf88-2aec-40d8-84c8-897f07016dd3 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b" status: 200 len: 1507 microversion: 2.1 time: 0.171400 May 26 16:43:08.699169 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 152/299] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:08 2022] GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:43:09.271895 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6b9b521b-9e08-404e-8528-344d7a8b9d91 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:09.272696 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-6b9b521b-9e08-404e-8528-344d7a8b9d91 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:09.279483 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6b9b521b-9e08-404e-8528-344d7a8b9d91 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:09.280005 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6b9b521b-9e08-404e-8528-344d7a8b9d91 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:09.280873 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6b9b521b-9e08-404e-8528-344d7a8b9d91 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:09.281397 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6b9b521b-9e08-404e-8528-344d7a8b9d91 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:09.427878 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6b9b521b-9e08-404e-8528-344d7a8b9d91 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:09.437587 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6b9b521b-9e08-404e-8528-344d7a8b9d91 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.169676 May 26 16:43:09.439725 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 148/300] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:09 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:09.718601 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-072402c5-b095-4d94-91a6-6866c4d96140 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:09.719806 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-072402c5-b095-4d94-91a6-6866c4d96140 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: 5ae2e40f-2c92-4e19-8126-ba183bb7b14b] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:09.728675 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-072402c5-b095-4d94-91a6-6866c4d96140 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:09.729227 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-072402c5-b095-4d94-91a6-6866c4d96140 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:09.730471 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-072402c5-b095-4d94-91a6-6866c4d96140 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:09.731101 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-072402c5-b095-4d94-91a6-6866c4d96140 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:09.902798 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-072402c5-b095-4d94-91a6-6866c4d96140 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:09.911150 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-072402c5-b095-4d94-91a6-6866c4d96140 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b" status: 200 len: 1507 microversion: 2.1 time: 0.199363 May 26 16:43:09.911912 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 153/301] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:09 2022] GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b => generated 1507 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:10.270698 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-530481fe-f596-45c2-9e0d-ecc71d7fa569 req-a3e64885-12c9-46a3-8a51-f46f9792fdab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ae2e40f-2c92-4e19-8126-ba183bb7b14b", "name": "network-vif-unplugged", "status": "completed", "tag": "f23e1dc1-523f-4d3b-8009-7b28b75b6bcd"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:43:10.282171 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-530481fe-f596-45c2-9e0d-ecc71d7fa569 req-a3e64885-12c9-46a3-8a51-f46f9792fdab service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:10.282913 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-530481fe-f596-45c2-9e0d-ecc71d7fa569 req-a3e64885-12c9-46a3-8a51-f46f9792fdab service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:10.296917 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-530481fe-f596-45c2-9e0d-ecc71d7fa569 req-a3e64885-12c9-46a3-8a51-f46f9792fdab service nova] Creating event network-vif-unplugged:f23e1dc1-523f-4d3b-8009-7b28b75b6bcd for instance 5ae2e40f-2c92-4e19-8126-ba183bb7b14b on hv-cinder-83607 May 26 16:43:10.302812 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-530481fe-f596-45c2-9e0d-ecc71d7fa569 req-a3e64885-12c9-46a3-8a51-f46f9792fdab service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037063 May 26 16:43:10.303229 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 149/302] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:43:10.456015 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-772e2944-eef6-40bf-9203-25914fdeb6e5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:10.456878 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-772e2944-eef6-40bf-9203-25914fdeb6e5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:10.463944 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-772e2944-eef6-40bf-9203-25914fdeb6e5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:10.464721 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-772e2944-eef6-40bf-9203-25914fdeb6e5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:10.465997 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-772e2944-eef6-40bf-9203-25914fdeb6e5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:10.466408 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-772e2944-eef6-40bf-9203-25914fdeb6e5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:10.626389 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-772e2944-eef6-40bf-9203-25914fdeb6e5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:10.635224 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-772e2944-eef6-40bf-9203-25914fdeb6e5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.183498 May 26 16:43:10.635808 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 154/303] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:10 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:43:10.931584 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d783eb92-8c64-44e2-85a7-55ed2717a886 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:10.932202 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d783eb92-8c64-44e2-85a7-55ed2717a886 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: 5ae2e40f-2c92-4e19-8126-ba183bb7b14b] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:10.939439 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d783eb92-8c64-44e2-85a7-55ed2717a886 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:10.939890 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d783eb92-8c64-44e2-85a7-55ed2717a886 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:10.940826 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d783eb92-8c64-44e2-85a7-55ed2717a886 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:10.941261 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d783eb92-8c64-44e2-85a7-55ed2717a886 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:11.095697 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d783eb92-8c64-44e2-85a7-55ed2717a886 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:11.109211 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d783eb92-8c64-44e2-85a7-55ed2717a886 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b" status: 200 len: 1507 microversion: 2.1 time: 0.182089 May 26 16:43:11.111086 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 150/304] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:10 2022] GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b => generated 1507 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:11.654009 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-9c23c50b-866f-4485-a5df-f07b3895d428 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:11.654656 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-9c23c50b-866f-4485-a5df-f07b3895d428 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:11.661450 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9c23c50b-866f-4485-a5df-f07b3895d428 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:11.661900 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9c23c50b-866f-4485-a5df-f07b3895d428 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:11.662702 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9c23c50b-866f-4485-a5df-f07b3895d428 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:11.663121 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9c23c50b-866f-4485-a5df-f07b3895d428 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:11.806696 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-9c23c50b-866f-4485-a5df-f07b3895d428 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:11.816235 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-9c23c50b-866f-4485-a5df-f07b3895d428 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.167173 May 26 16:43:11.816878 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 155/305] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:11 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:12.128952 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a2d8beab-b337-4ae1-b559-0a70fa831b97 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:12.129512 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a2d8beab-b337-4ae1-b559-0a70fa831b97 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: 5ae2e40f-2c92-4e19-8126-ba183bb7b14b] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:12.136897 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a2d8beab-b337-4ae1-b559-0a70fa831b97 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:12.137345 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a2d8beab-b337-4ae1-b559-0a70fa831b97 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:12.138129 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a2d8beab-b337-4ae1-b559-0a70fa831b97 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:12.138567 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a2d8beab-b337-4ae1-b559-0a70fa831b97 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:12.286567 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a2d8beab-b337-4ae1-b559-0a70fa831b97 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:12.294305 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a2d8beab-b337-4ae1-b559-0a70fa831b97 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b" status: 200 len: 1507 microversion: 2.1 time: 0.169576 May 26 16:43:12.294888 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 151/306] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:12 2022] GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b => generated 1507 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:43:12.845216 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-4cdd799b-e7de-4f25-a0c3-9f65fa21c141 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:12.846140 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-4cdd799b-e7de-4f25-a0c3-9f65fa21c141 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:12.856639 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4cdd799b-e7de-4f25-a0c3-9f65fa21c141 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:12.857420 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4cdd799b-e7de-4f25-a0c3-9f65fa21c141 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:12.859121 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4cdd799b-e7de-4f25-a0c3-9f65fa21c141 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:12.859945 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4cdd799b-e7de-4f25-a0c3-9f65fa21c141 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:13.145052 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-4cdd799b-e7de-4f25-a0c3-9f65fa21c141 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:13.153447 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-4cdd799b-e7de-4f25-a0c3-9f65fa21c141 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.314666 May 26 16:43:13.154064 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 156/307] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:12 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:13.315472 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e6950b2c-cd23-498f-ba40-6acd78911757 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:13.318028 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e6950b2c-cd23-498f-ba40-6acd78911757 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: 5ae2e40f-2c92-4e19-8126-ba183bb7b14b] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:13.325221 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e6950b2c-cd23-498f-ba40-6acd78911757 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:13.325664 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e6950b2c-cd23-498f-ba40-6acd78911757 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:13.326666 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e6950b2c-cd23-498f-ba40-6acd78911757 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:13.327100 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e6950b2c-cd23-498f-ba40-6acd78911757 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:13.737308 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e6950b2c-cd23-498f-ba40-6acd78911757 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:13.741910 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-a77f64ab-5ac0-4c23-8769-ab9474980705 req-0b553a46-c2ea-4dfc-a100-623e3db76425 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ae2e40f-2c92-4e19-8126-ba183bb7b14b", "name": "network-vif-deleted", "tag": "f23e1dc1-523f-4d3b-8009-7b28b75b6bcd"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:43:13.752839 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e6950b2c-cd23-498f-ba40-6acd78911757 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b" status: 200 len: 1507 microversion: 2.1 time: 0.444130 May 26 16:43:13.764051 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 152/308] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:13 2022] GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b => generated 1507 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:13.764568 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-a77f64ab-5ac0-4c23-8769-ab9474980705 req-0b553a46-c2ea-4dfc-a100-623e3db76425 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:13.764568 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-a77f64ab-5ac0-4c23-8769-ab9474980705 req-0b553a46-c2ea-4dfc-a100-623e3db76425 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:13.776441 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-a77f64ab-5ac0-4c23-8769-ab9474980705 req-0b553a46-c2ea-4dfc-a100-623e3db76425 service nova] Creating event network-vif-deleted:f23e1dc1-523f-4d3b-8009-7b28b75b6bcd for instance 5ae2e40f-2c92-4e19-8126-ba183bb7b14b on hv-cinder-83607 May 26 16:43:13.785228 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-a77f64ab-5ac0-4c23-8769-ab9474980705 req-0b553a46-c2ea-4dfc-a100-623e3db76425 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057160 May 26 16:43:13.786386 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 157/309] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:43:14.171862 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-5221cafa-9113-4ca4-9c77-3be356a20312 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:14.172562 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-5221cafa-9113-4ca4-9c77-3be356a20312 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:14.178830 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5221cafa-9113-4ca4-9c77-3be356a20312 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:14.179281 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5221cafa-9113-4ca4-9c77-3be356a20312 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:14.180051 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5221cafa-9113-4ca4-9c77-3be356a20312 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:14.180594 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5221cafa-9113-4ca4-9c77-3be356a20312 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:14.331509 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-5221cafa-9113-4ca4-9c77-3be356a20312 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:14.340731 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-5221cafa-9113-4ca4-9c77-3be356a20312 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.172583 May 26 16:43:14.341228 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 153/310] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:14 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:43:14.781456 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-04a0e33e-a705-4ba5-9c00-1fd883b60146 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:14.782510 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-04a0e33e-a705-4ba5-9c00-1fd883b60146 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: 5ae2e40f-2c92-4e19-8126-ba183bb7b14b] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:14.791573 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-04a0e33e-a705-4ba5-9c00-1fd883b60146 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:14.792494 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-04a0e33e-a705-4ba5-9c00-1fd883b60146 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:14.794044 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-04a0e33e-a705-4ba5-9c00-1fd883b60146 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:14.794935 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-04a0e33e-a705-4ba5-9c00-1fd883b60146 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:14.840563 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-04a0e33e-a705-4ba5-9c00-1fd883b60146 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:14.841002 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-04a0e33e-a705-4ba5-9c00-1fd883b60146 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:14.841470 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.objects.instance [None req-04a0e33e-a705-4ba5-9c00-1fd883b60146 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lazy-loading 'fault' on Instance uuid 5ae2e40f-2c92-4e19-8126-ba183bb7b14b {{(pid=124267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:43:14.894801 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-04a0e33e-a705-4ba5-9c00-1fd883b60146 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:14.910411 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-04a0e33e-a705-4ba5-9c00-1fd883b60146 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b" status: 200 len: 1308 microversion: 2.1 time: 0.134664 May 26 16:43:14.911442 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 158/311] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:14 2022] GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b => generated 1308 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:15.362853 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e0ecafa5-c28c-4021-992a-d4706c54d468 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:15.364267 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e0ecafa5-c28c-4021-992a-d4706c54d468 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:15.377712 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e0ecafa5-c28c-4021-992a-d4706c54d468 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:15.378687 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e0ecafa5-c28c-4021-992a-d4706c54d468 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:15.381253 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e0ecafa5-c28c-4021-992a-d4706c54d468 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:15.382122 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e0ecafa5-c28c-4021-992a-d4706c54d468 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:15.549101 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e0ecafa5-c28c-4021-992a-d4706c54d468 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:15.558020 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e0ecafa5-c28c-4021-992a-d4706c54d468 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1526 microversion: 2.1 time: 0.202175 May 26 16:43:15.558619 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 154/312] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:15 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1526 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:15.941254 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-e546e03d-de28-4cf4-b733-e8e786fa7c81 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:15.944770 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-e546e03d-de28-4cf4-b733-e8e786fa7c81 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: 5ae2e40f-2c92-4e19-8126-ba183bb7b14b] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:15.979188 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e546e03d-de28-4cf4-b733-e8e786fa7c81 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:15.980008 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e546e03d-de28-4cf4-b733-e8e786fa7c81 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:15.983578 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e546e03d-de28-4cf4-b733-e8e786fa7c81 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:15.985675 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e546e03d-de28-4cf4-b733-e8e786fa7c81 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:16.067434 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e546e03d-de28-4cf4-b733-e8e786fa7c81 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:16.067887 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e546e03d-de28-4cf4-b733-e8e786fa7c81 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:16.068363 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.objects.instance [None req-e546e03d-de28-4cf4-b733-e8e786fa7c81 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lazy-loading 'fault' on Instance uuid 5ae2e40f-2c92-4e19-8126-ba183bb7b14b {{(pid=124267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:43:16.128628 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-e546e03d-de28-4cf4-b733-e8e786fa7c81 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:16.139033 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-e546e03d-de28-4cf4-b733-e8e786fa7c81 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b" status: 200 len: 1308 microversion: 2.1 time: 0.209908 May 26 16:43:16.141329 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 159/313] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:15 2022] GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b => generated 1308 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:16.587672 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0eaee557-9cec-42da-b662-dcbf55a9e17e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:16.588327 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0eaee557-9cec-42da-b662-dcbf55a9e17e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:16.596614 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0eaee557-9cec-42da-b662-dcbf55a9e17e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:16.597365 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0eaee557-9cec-42da-b662-dcbf55a9e17e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:16.598175 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0eaee557-9cec-42da-b662-dcbf55a9e17e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:16.598607 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0eaee557-9cec-42da-b662-dcbf55a9e17e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:16.813522 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0eaee557-9cec-42da-b662-dcbf55a9e17e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:16.825189 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0eaee557-9cec-42da-b662-dcbf55a9e17e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1506 microversion: 2.1 time: 0.245794 May 26 16:43:16.826375 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 155/314] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:16 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1506 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:16.842418 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-db048ad4-cbcc-4426-985b-d6a6bc439a5c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:16.843130 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-db048ad4-cbcc-4426-985b-d6a6bc439a5c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:16.849376 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-db048ad4-cbcc-4426-985b-d6a6bc439a5c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:16.849913 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-db048ad4-cbcc-4426-985b-d6a6bc439a5c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:16.853987 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-db048ad4-cbcc-4426-985b-d6a6bc439a5c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:16.854512 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-db048ad4-cbcc-4426-985b-d6a6bc439a5c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:17.073415 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-db048ad4-cbcc-4426-985b-d6a6bc439a5c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:17.082324 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-db048ad4-cbcc-4426-985b-d6a6bc439a5c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1518 microversion: 2.1 time: 0.243869 May 26 16:43:17.083058 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 160/315] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:16 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1518 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:17.177110 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3509d5c4-2514-4d40-90bf-677a6a77165a tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:17.179700 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-3509d5c4-2514-4d40-90bf-677a6a77165a tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: 5ae2e40f-2c92-4e19-8126-ba183bb7b14b] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:17.204017 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3509d5c4-2514-4d40-90bf-677a6a77165a tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:17.205193 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3509d5c4-2514-4d40-90bf-677a6a77165a tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:17.206939 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3509d5c4-2514-4d40-90bf-677a6a77165a tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:17.208567 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3509d5c4-2514-4d40-90bf-677a6a77165a tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:17.242463 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-3509d5c4-2514-4d40-90bf-677a6a77165a tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] HTTP exception thrown: Instance 5ae2e40f-2c92-4e19-8126-ba183bb7b14b could not be found. May 26 16:43:17.246531 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3509d5c4-2514-4d40-90bf-677a6a77165a tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Request method failure captured: May 26 16:43:17.246531 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b HTTP/1.1 May 26 16:43:17.246531 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept: application/json May 26 16:43:17.246531 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity May 26 16:43:17.246531 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Connection: close May 26 16:43:17.246531 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Length: 0 May 26 16:43:17.246531 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Type: application/json May 26 16:43:17.246531 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Host: 10.222.0.102 May 26 16:43:17.246531 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None May 26 16:43:17.246531 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 May 26 16:43:17.246531 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABij631iL0b9u0DjlSfbPtObZdXB_e2n5baM7L-v1WB5bMbW9OeL5HFoPIemnAUzoIxF8onqAqpINSa7ciCDeHBGvN4qhy_t5OwIfBQFdy4IIDmC-KzjcINQa7_vdFCdIRZ7SaKGSoXtxLwu9vFj-DkyrWig9MXe7yI7yxHjcJuXtvYJZU May 26 16:43:17.246531 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Id: None May 26 16:43:17.246531 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Name: None May 26 16:43:17.246531 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed May 26 16:43:17.246531 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True May 26 16:43:17.246531 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default May 26 16:43:17.246531 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default May 26 16:43:17.246531 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Id: 9f81bd02cdf94ff98c1e9534199b425c May 26 16:43:17.246531 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-VolumesActionsTest-980100776 May 26 16:43:17.246531 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Role: reader,member May 26 16:43:17.246531 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Roles: reader,member May 26 16:43:17.248476 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/9f81bd02cdf94ff98c1e9534199b425c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/9f81bd02cdf94ff98c1e9534199b425c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/9f81bd02cdf94ff98c1e9534199b425c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_9f81bd02cdf94ff98c1e9534199b425c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:43:17.248476 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-VolumesActionsTest-980100776 May 26 16:43:17.248476 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Id: 9f81bd02cdf94ff98c1e9534199b425c May 26 16:43:17.248476 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-VolumesActionsTest-980100776 May 26 16:43:17.248476 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User: tempest-VolumesActionsTest-980100776-project May 26 16:43:17.248476 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default May 26 16:43:17.248476 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default May 26 16:43:17.248476 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Id: 9c0fb73a262843f89285a6e161a1abed May 26 16:43:17.248476 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-VolumesActionsTest-980100776-project May 26 16:43:17.248476 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: method: > May 26 16:43:17.248476 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: exception: Instance 5ae2e40f-2c92-4e19-8126-ba183bb7b14b could not be found. May 26 16:43:17.248476 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: action_args: {'id': '5ae2e40f-2c92-4e19-8126-ba183bb7b14b'} May 26 16:43:17.249399 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:43:17.249399 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:43:17.249399 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:43:17.249399 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:43:17.249399 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:43:17.249399 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:43:17.249399 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:43:17.249399 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:43:17.249399 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:43:17.249399 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:43:17.249399 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ae2e40f-2c92-4e19-8126-ba183bb7b14b could not be found. May 26 16:43:17.249399 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:43:17.249399 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:43:17.249399 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:43:17.249399 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:43:17.249399 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:43:17.249399 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:43:17.249399 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:43:17.249399 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:43:17.249399 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:43:17.251203 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:43:17.251203 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 16:43:17.251203 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 16:43:17.251203 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:43:17.251203 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:43:17.251203 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:43:17.251203 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:43:17.251203 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ae2e40f-2c92-4e19-8126-ba183bb7b14b could not be found. May 26 16:43:17.251203 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:43:17.251203 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:43:17.251203 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:43:17.251203 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:43:17.251203 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:43:17.251203 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:43:17.251203 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:43:17.251203 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:43:17.251203 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ae2e40f-2c92-4e19-8126-ba183bb7b14b could not be found. May 26 16:43:17.251203 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:43:17.254211 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3509d5c4-2514-4d40-90bf-677a6a77165a tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Returning 404 to user: Instance 5ae2e40f-2c92-4e19-8126-ba183bb7b14b could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:43:17.255520 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-3509d5c4-2514-4d40-90bf-677a6a77165a tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b" status: 404 len: 111 microversion: 2.1 time: 0.094647 May 26 16:43:17.256786 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 156/316] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:17 2022] GET /compute/v2.1/servers/5ae2e40f-2c92-4e19-8126-ba183bb7b14b => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 16:43:17.501050 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-a3cfde22-cb63-44ce-a113-7523df55fb20 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1009127717", "imageRef": "d74c4a51-21fe-41d5-865a-cb93604ac3aa", "flavorRef": "452", "networks": [{"uuid": "e501901b-6f86-4144-9120-72f2aacdc277"}]}} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:43:17.576259 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.network.neutron [None req-a3cfde22-cb63-44ce-a113-7523df55fb20 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] validate_networks() for [('e501901b-6f86-4144-9120-72f2aacdc277', None, None, None, None, None)] {{(pid=124267) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:43:18.502597 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-a3cfde22-cb63-44ce-a113-7523df55fb20 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Flavor limits 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:43:18.503242 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-a3cfde22-cb63-44ce-a113-7523df55fb20 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Image limits 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:43:18.503516 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-a3cfde22-cb63-44ce-a113-7523df55fb20 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Flavor pref 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:43:18.503928 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-a3cfde22-cb63-44ce-a113-7523df55fb20 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Image pref 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:43:18.504487 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-a3cfde22-cb63-44ce-a113-7523df55fb20 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:43:18.514696 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a3cfde22-cb63-44ce-a113-7523df55fb20 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:18.515158 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a3cfde22-cb63-44ce-a113-7523df55fb20 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:18.515951 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a3cfde22-cb63-44ce-a113-7523df55fb20 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:18.516422 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a3cfde22-cb63-44ce-a113-7523df55fb20 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:18.540858 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.quota [None req-a3cfde22-cb63-44ce-a113-7523df55fb20 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Getting quotas for project 9f81bd02cdf94ff98c1e9534199b425c. Resources: {'cores', 'instances', 'ram'} {{(pid=124267) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:43:18.548801 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.quota [None req-a3cfde22-cb63-44ce-a113-7523df55fb20 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Getting quotas for user 9c0fb73a262843f89285a6e161a1abed and project 9f81bd02cdf94ff98c1e9534199b425c. Resources: {'cores', 'instances', 'ram'} {{(pid=124267) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:43:18.567135 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-a3cfde22-cb63-44ce-a113-7523df55fb20 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Going to run 1 instances... {{(pid=124267) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:43:18.569796 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-a3cfde22-cb63-44ce-a113-7523df55fb20 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: a5423742-f6e7-40c5-98d6-50f28c3c18ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d74c4a51-21fe-41d5-865a-cb93604ac3aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:43:18.620045 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-a3cfde22-cb63-44ce-a113-7523df55fb20 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.124967 May 26 16:43:18.620748 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 161/317] 10.222.0.102 () {60 vars in 1151 bytes} [Thu May 26 16:43:17 2022] POST /compute/v2.1/servers => generated 382 bytes in 1126 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 16:43:18.631028 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8968efe2-ca54-4130-9247-a6d9a9852328 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:18.631640 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-8968efe2-ca54-4130-9247-a6d9a9852328 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: a5423742-f6e7-40c5-98d6-50f28c3c18ae] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:18.701555 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8968efe2-ca54-4130-9247-a6d9a9852328 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:18.709681 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-8968efe2-ca54-4130-9247-a6d9a9852328 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae" status: 200 len: 1218 microversion: 2.1 time: 0.082537 May 26 16:43:18.710897 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 157/318] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:18 2022] GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:19.728659 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-1f7760e7-24a4-4593-906b-8bdb7ab9cf2a tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:19.729278 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-1f7760e7-24a4-4593-906b-8bdb7ab9cf2a tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: a5423742-f6e7-40c5-98d6-50f28c3c18ae] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:19.736029 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1f7760e7-24a4-4593-906b-8bdb7ab9cf2a tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:19.736548 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1f7760e7-24a4-4593-906b-8bdb7ab9cf2a tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:19.737329 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1f7760e7-24a4-4593-906b-8bdb7ab9cf2a tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:19.737759 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1f7760e7-24a4-4593-906b-8bdb7ab9cf2a tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:19.742231 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=100 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:19.812049 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-1f7760e7-24a4-4593-906b-8bdb7ab9cf2a tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:19.823507 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-1f7760e7-24a4-4593-906b-8bdb7ab9cf2a tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae" status: 200 len: 1222 microversion: 2.1 time: 0.099299 May 26 16:43:19.824058 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 162/319] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:19 2022] GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae => generated 1222 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:43:20.853005 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e041af4a-a536-4886-96f2-49f2f5bf4770 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:20.853785 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e041af4a-a536-4886-96f2-49f2f5bf4770 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: a5423742-f6e7-40c5-98d6-50f28c3c18ae] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:20.869667 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e041af4a-a536-4886-96f2-49f2f5bf4770 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:20.870540 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e041af4a-a536-4886-96f2-49f2f5bf4770 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:20.871862 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e041af4a-a536-4886-96f2-49f2f5bf4770 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:20.872757 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e041af4a-a536-4886-96f2-49f2f5bf4770 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:20.974442 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e041af4a-a536-4886-96f2-49f2f5bf4770 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:20.983120 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e041af4a-a536-4886-96f2-49f2f5bf4770 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae" status: 200 len: 1222 microversion: 2.1 time: 0.139236 May 26 16:43:20.983679 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 158/320] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:20 2022] GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae => generated 1222 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:43:22.003677 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-b1c2c15c-a79b-4179-87cd-6eab9a7b2560 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:22.004886 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-b1c2c15c-a79b-4179-87cd-6eab9a7b2560 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: a5423742-f6e7-40c5-98d6-50f28c3c18ae] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:22.015939 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b1c2c15c-a79b-4179-87cd-6eab9a7b2560 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:22.016787 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b1c2c15c-a79b-4179-87cd-6eab9a7b2560 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:22.018160 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b1c2c15c-a79b-4179-87cd-6eab9a7b2560 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:22.018927 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b1c2c15c-a79b-4179-87cd-6eab9a7b2560 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:22.115986 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-b1c2c15c-a79b-4179-87cd-6eab9a7b2560 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:22.126093 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-b1c2c15c-a79b-4179-87cd-6eab9a7b2560 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae" status: 200 len: 1270 microversion: 2.1 time: 0.129659 May 26 16:43:22.126719 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 163/321] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:21 2022] GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae => generated 1270 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:23.152876 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7ee27dbb-5050-4b6c-bd01-0f5d8b8fcfbf tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:23.154185 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-7ee27dbb-5050-4b6c-bd01-0f5d8b8fcfbf tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: a5423742-f6e7-40c5-98d6-50f28c3c18ae] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:23.167530 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7ee27dbb-5050-4b6c-bd01-0f5d8b8fcfbf tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:23.168815 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7ee27dbb-5050-4b6c-bd01-0f5d8b8fcfbf tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:23.170695 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7ee27dbb-5050-4b6c-bd01-0f5d8b8fcfbf tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:23.172132 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7ee27dbb-5050-4b6c-bd01-0f5d8b8fcfbf tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:23.449335 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7ee27dbb-5050-4b6c-bd01-0f5d8b8fcfbf tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:23.458515 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7ee27dbb-5050-4b6c-bd01-0f5d8b8fcfbf tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae" status: 200 len: 1318 microversion: 2.1 time: 0.317451 May 26 16:43:23.459136 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 159/322] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:23 2022] GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:43:24.278374 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-2f868042-91cd-4563-913d-80982cdf0d7d req-491d2d3e-f85b-4e13-aee6-117aa29f7e16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5423742-f6e7-40c5-98d6-50f28c3c18ae", "tag": "5fab6735-79e4-4e3b-8254-559430f3ce8a"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:43:24.286931 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-841fc8fe-de0c-4e83-a6fa-5ea3769c2181 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:43:24.290420 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-841fc8fe-de0c-4e83-a6fa-5ea3769c2181 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:24.297236 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-2f868042-91cd-4563-913d-80982cdf0d7d req-491d2d3e-f85b-4e13-aee6-117aa29f7e16 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:24.297693 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-2f868042-91cd-4563-913d-80982cdf0d7d req-491d2d3e-f85b-4e13-aee6-117aa29f7e16 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:24.312785 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-841fc8fe-de0c-4e83-a6fa-5ea3769c2181 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:24.313243 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-841fc8fe-de0c-4e83-a6fa-5ea3769c2181 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:24.314715 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-841fc8fe-de0c-4e83-a6fa-5ea3769c2181 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:24.315721 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-841fc8fe-de0c-4e83-a6fa-5ea3769c2181 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:24.321292 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-2f868042-91cd-4563-913d-80982cdf0d7d req-491d2d3e-f85b-4e13-aee6-117aa29f7e16 service nova] Creating event network-changed:5fab6735-79e4-4e3b-8254-559430f3ce8a for instance a5423742-f6e7-40c5-98d6-50f28c3c18ae on hv-cinder-83607 May 26 16:43:24.337047 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-2f868042-91cd-4563-913d-80982cdf0d7d req-491d2d3e-f85b-4e13-aee6-117aa29f7e16 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066605 May 26 16:43:24.337709 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 164/323] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:43:24.355704 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.objects.instance [None req-841fc8fe-de0c-4e83-a6fa-5ea3769c2181 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lazy-loading 'flavor' on Instance uuid 6a691d98-aaca-4c24-9200-19517540e68e {{(pid=124266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:43:24.485552 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-841fc8fe-de0c-4e83-a6fa-5ea3769c2181 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "POST /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e/action" status: 200 len: 32 microversion: 2.1 time: 0.208044 May 26 16:43:24.488463 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 160/324] 10.222.0.102 () {60 vars in 1282 bytes} [Thu May 26 16:43:24 2022] POST /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e/action => generated 32 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 16:43:24.496039 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-1ab0e4bd-71ff-4b07-b83a-8e6facfa3255 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:24.497728 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-1ab0e4bd-71ff-4b07-b83a-8e6facfa3255 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: a5423742-f6e7-40c5-98d6-50f28c3c18ae] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:24.506718 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-30a482ca-c2a8-44f0-9509-417693ce3cc1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:24.507860 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-30a482ca-c2a8-44f0-9509-417693ce3cc1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:24.517868 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1ab0e4bd-71ff-4b07-b83a-8e6facfa3255 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:24.519247 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1ab0e4bd-71ff-4b07-b83a-8e6facfa3255 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:24.519439 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-30a482ca-c2a8-44f0-9509-417693ce3cc1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:24.520127 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-30a482ca-c2a8-44f0-9509-417693ce3cc1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:24.521723 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1ab0e4bd-71ff-4b07-b83a-8e6facfa3255 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:24.521918 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-30a482ca-c2a8-44f0-9509-417693ce3cc1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:24.522579 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-30a482ca-c2a8-44f0-9509-417693ce3cc1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:24.524521 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1ab0e4bd-71ff-4b07-b83a-8e6facfa3255 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:24.979490 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-30a482ca-c2a8-44f0-9509-417693ce3cc1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:24.987874 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-30a482ca-c2a8-44f0-9509-417693ce3cc1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1524 microversion: 2.1 time: 0.492774 May 26 16:43:24.988693 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 161/325] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:24 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1524 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:43:24.993491 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-5d16762a-11eb-4434-893a-91fb1d1d3399 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-584200288", "imageRef": "d74c4a51-21fe-41d5-865a-cb93604ac3aa", "flavorRef": "452"}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:43:25.003459 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-1ab0e4bd-71ff-4b07-b83a-8e6facfa3255 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:25.015719 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-1ab0e4bd-71ff-4b07-b83a-8e6facfa3255 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae" status: 200 len: 1318 microversion: 2.1 time: 0.538573 May 26 16:43:25.017174 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 165/326] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:24 2022] GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae => generated 1318 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:25.054806 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.network.neutron [None req-5d16762a-11eb-4434-893a-91fb1d1d3399 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] validate_networks() for None {{(pid=124266) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:43:25.538571 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-5d16762a-11eb-4434-893a-91fb1d1d3399 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Flavor limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:43:25.539216 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-5d16762a-11eb-4434-893a-91fb1d1d3399 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Image limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:43:25.539926 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-5d16762a-11eb-4434-893a-91fb1d1d3399 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Flavor pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:43:25.540620 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-5d16762a-11eb-4434-893a-91fb1d1d3399 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Image pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:43:25.542158 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-5d16762a-11eb-4434-893a-91fb1d1d3399 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:43:25.555948 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5d16762a-11eb-4434-893a-91fb1d1d3399 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:25.556686 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5d16762a-11eb-4434-893a-91fb1d1d3399 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:25.557714 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5d16762a-11eb-4434-893a-91fb1d1d3399 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:25.558246 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5d16762a-11eb-4434-893a-91fb1d1d3399 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:25.566250 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:25.581300 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-5d16762a-11eb-4434-893a-91fb1d1d3399 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Getting quotas for project 2b4d322cc014464da21503514cd08b91. Resources: {'cores', 'instances', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:43:25.586287 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-5d16762a-11eb-4434-893a-91fb1d1d3399 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Getting quotas for user 6f67b0bec1d74cf1a07415665e782d2e and project 2b4d322cc014464da21503514cd08b91. Resources: {'cores', 'instances', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:43:25.599833 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-5d16762a-11eb-4434-893a-91fb1d1d3399 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Going to run 1 instances... {{(pid=124266) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:43:25.602510 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-5d16762a-11eb-4434-893a-91fb1d1d3399 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] [instance: e2f08adf-3dbf-4829-9761-dca0ea87c997] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d74c4a51-21fe-41d5-865a-cb93604ac3aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:43:25.657214 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-5d16762a-11eb-4434-893a-91fb1d1d3399 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.667337 May 26 16:43:25.662837 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 162/327] 10.222.0.102 () {60 vars in 1151 bytes} [Thu May 26 16:43:24 2022] POST /compute/v2.1/servers => generated 382 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 16:43:25.672532 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-e7c203f3-0c85-4a2f-be71-e3ffd2579874 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:25.673754 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-e7c203f3-0c85-4a2f-be71-e3ffd2579874 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] [instance: e2f08adf-3dbf-4829-9761-dca0ea87c997] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:25.741099 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-e7c203f3-0c85-4a2f-be71-e3ffd2579874 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67b0bec1d74cf1a07415665e782d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4d322cc014464da21503514cd08b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:25.756928 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-e7c203f3-0c85-4a2f-be71-e3ffd2579874 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] 10.222.0.102 "GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997" status: 200 len: 1218 microversion: 2.1 time: 0.092199 May 26 16:43:25.757520 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 166/328] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:25 2022] GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:26.015294 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e2464f21-bf26-45ca-9ade-7fa0b54a9186 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:26.016209 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e2464f21-bf26-45ca-9ade-7fa0b54a9186 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:26.022855 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e2464f21-bf26-45ca-9ade-7fa0b54a9186 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:26.023315 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e2464f21-bf26-45ca-9ade-7fa0b54a9186 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:26.024137 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e2464f21-bf26-45ca-9ade-7fa0b54a9186 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:26.024617 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e2464f21-bf26-45ca-9ade-7fa0b54a9186 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:26.034568 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-77fecd9b-9cb9-4d74-b89a-b080701ccabe tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:26.035457 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-77fecd9b-9cb9-4d74-b89a-b080701ccabe tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: a5423742-f6e7-40c5-98d6-50f28c3c18ae] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:26.042720 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-77fecd9b-9cb9-4d74-b89a-b080701ccabe tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:26.043550 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-77fecd9b-9cb9-4d74-b89a-b080701ccabe tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:26.044416 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-77fecd9b-9cb9-4d74-b89a-b080701ccabe tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:26.045056 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-77fecd9b-9cb9-4d74-b89a-b080701ccabe tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:26.301365 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e2464f21-bf26-45ca-9ade-7fa0b54a9186 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:26.306601 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-77fecd9b-9cb9-4d74-b89a-b080701ccabe tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:26.312705 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e2464f21-bf26-45ca-9ade-7fa0b54a9186 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1524 microversion: 2.1 time: 0.302221 May 26 16:43:26.313484 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 163/329] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:26 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1524 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:26.323718 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-77fecd9b-9cb9-4d74-b89a-b080701ccabe tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae" status: 200 len: 1318 microversion: 2.1 time: 0.293602 May 26 16:43:26.324324 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 167/330] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:26 2022] GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:43:26.776157 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-324879a1-345c-4556-b298-56eef7f7558d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:26.776808 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-324879a1-345c-4556-b298-56eef7f7558d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] [instance: e2f08adf-3dbf-4829-9761-dca0ea87c997] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:26.785348 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-324879a1-345c-4556-b298-56eef7f7558d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:26.786080 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-324879a1-345c-4556-b298-56eef7f7558d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:26.787544 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-324879a1-345c-4556-b298-56eef7f7558d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:26.788342 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-324879a1-345c-4556-b298-56eef7f7558d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:26.861060 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-324879a1-345c-4556-b298-56eef7f7558d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67b0bec1d74cf1a07415665e782d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4d322cc014464da21503514cd08b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:26.872553 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-324879a1-345c-4556-b298-56eef7f7558d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] 10.222.0.102 "GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997" status: 200 len: 1222 microversion: 2.1 time: 0.100687 May 26 16:43:26.873574 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 164/331] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:26 2022] GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997 => generated 1222 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:27.341961 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-78a67b8a-be5c-4198-b08e-aa7e3196d9fe tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:27.344046 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-78a67b8a-be5c-4198-b08e-aa7e3196d9fe tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:27.344568 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-fa9ca013-c3c8-41e3-aabd-65039498ee2d tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:27.345833 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-fa9ca013-c3c8-41e3-aabd-65039498ee2d tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: a5423742-f6e7-40c5-98d6-50f28c3c18ae] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:27.355067 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fa9ca013-c3c8-41e3-aabd-65039498ee2d tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:27.355567 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-78a67b8a-be5c-4198-b08e-aa7e3196d9fe tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:27.356652 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-78a67b8a-be5c-4198-b08e-aa7e3196d9fe tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:27.356817 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fa9ca013-c3c8-41e3-aabd-65039498ee2d tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:27.357795 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fa9ca013-c3c8-41e3-aabd-65039498ee2d tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:27.358231 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fa9ca013-c3c8-41e3-aabd-65039498ee2d tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:27.359063 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-78a67b8a-be5c-4198-b08e-aa7e3196d9fe tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:27.360051 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-78a67b8a-be5c-4198-b08e-aa7e3196d9fe tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:27.660361 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-fa9ca013-c3c8-41e3-aabd-65039498ee2d tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:27.682857 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-78a67b8a-be5c-4198-b08e-aa7e3196d9fe tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:27.697413 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-fa9ca013-c3c8-41e3-aabd-65039498ee2d tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae" status: 200 len: 1318 microversion: 2.1 time: 0.336415 May 26 16:43:27.698844 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 165/332] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:27 2022] GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae => generated 1318 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:43:27.701038 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-78a67b8a-be5c-4198-b08e-aa7e3196d9fe tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1524 microversion: 2.1 time: 0.366366 May 26 16:43:27.719583 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 168/333] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:27 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1524 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:27.897696 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ddde51e3-00e5-4dc2-bd90-3c57b24cfe6d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:27.899469 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ddde51e3-00e5-4dc2-bd90-3c57b24cfe6d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] [instance: e2f08adf-3dbf-4829-9761-dca0ea87c997] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:27.909281 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ddde51e3-00e5-4dc2-bd90-3c57b24cfe6d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:27.909594 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ddde51e3-00e5-4dc2-bd90-3c57b24cfe6d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:27.910588 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ddde51e3-00e5-4dc2-bd90-3c57b24cfe6d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:27.911139 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ddde51e3-00e5-4dc2-bd90-3c57b24cfe6d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:28.106122 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ddde51e3-00e5-4dc2-bd90-3c57b24cfe6d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67b0bec1d74cf1a07415665e782d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4d322cc014464da21503514cd08b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:28.115058 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ddde51e3-00e5-4dc2-bd90-3c57b24cfe6d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] 10.222.0.102 "GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997" status: 200 len: 1222 microversion: 2.1 time: 0.226674 May 26 16:43:28.115675 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 166/334] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:27 2022] GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997 => generated 1222 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:28.729334 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-edd4a69a-0022-40c5-882e-64b2dd55ac51 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:28.730432 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-edd4a69a-0022-40c5-882e-64b2dd55ac51 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: a5423742-f6e7-40c5-98d6-50f28c3c18ae] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:28.733175 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell0:SELECT=2 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:28.735435 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9e175c72-4e50-480b-aabd-3a0f8fe27040 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:28.736584 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9e175c72-4e50-480b-aabd-3a0f8fe27040 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:28.745571 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-edd4a69a-0022-40c5-882e-64b2dd55ac51 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:28.746398 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-edd4a69a-0022-40c5-882e-64b2dd55ac51 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:28.748184 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-edd4a69a-0022-40c5-882e-64b2dd55ac51 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:28.748985 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-edd4a69a-0022-40c5-882e-64b2dd55ac51 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:28.755502 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9e175c72-4e50-480b-aabd-3a0f8fe27040 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:28.756878 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9e175c72-4e50-480b-aabd-3a0f8fe27040 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:28.758250 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9e175c72-4e50-480b-aabd-3a0f8fe27040 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:28.758914 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9e175c72-4e50-480b-aabd-3a0f8fe27040 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:29.080594 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9e175c72-4e50-480b-aabd-3a0f8fe27040 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:29.086931 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-edd4a69a-0022-40c5-882e-64b2dd55ac51 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:29.098626 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9e175c72-4e50-480b-aabd-3a0f8fe27040 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1524 microversion: 2.1 time: 0.368898 May 26 16:43:29.099320 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-edd4a69a-0022-40c5-882e-64b2dd55ac51 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae" status: 200 len: 1318 microversion: 2.1 time: 0.375862 May 26 16:43:29.100044 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 167/335] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:28 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1524 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:29.100350 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 169/336] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:28 2022] GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae => generated 1318 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:29.143425 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0acad1f6-34f0-49c5-9bfc-6a8ce8d5adb6 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:29.144047 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0acad1f6-34f0-49c5-9bfc-6a8ce8d5adb6 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] [instance: e2f08adf-3dbf-4829-9761-dca0ea87c997] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:29.153024 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0acad1f6-34f0-49c5-9bfc-6a8ce8d5adb6 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:29.153490 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0acad1f6-34f0-49c5-9bfc-6a8ce8d5adb6 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:29.154272 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0acad1f6-34f0-49c5-9bfc-6a8ce8d5adb6 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:29.154696 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0acad1f6-34f0-49c5-9bfc-6a8ce8d5adb6 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:29.233581 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0acad1f6-34f0-49c5-9bfc-6a8ce8d5adb6 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67b0bec1d74cf1a07415665e782d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4d322cc014464da21503514cd08b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:29.247450 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0acad1f6-34f0-49c5-9bfc-6a8ce8d5adb6 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] 10.222.0.102 "GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997" status: 200 len: 1222 microversion: 2.1 time: 0.114967 May 26 16:43:29.248468 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 168/337] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:29 2022] GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997 => generated 1222 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:30.118413 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-7f25bba9-2664-4c5d-a935-ee662b4f7e11 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:30.119280 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-7f25bba9-2664-4c5d-a935-ee662b4f7e11 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: a5423742-f6e7-40c5-98d6-50f28c3c18ae] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:30.127466 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7f25bba9-2664-4c5d-a935-ee662b4f7e11 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:30.127749 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-b92ea227-75c9-4197-83d4-7bb635d31e37 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:30.128664 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7f25bba9-2664-4c5d-a935-ee662b4f7e11 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:30.128983 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7f25bba9-2664-4c5d-a935-ee662b4f7e11 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:30.129314 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-b92ea227-75c9-4197-83d4-7bb635d31e37 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:30.129511 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7f25bba9-2664-4c5d-a935-ee662b4f7e11 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:30.142634 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b92ea227-75c9-4197-83d4-7bb635d31e37 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:30.143158 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b92ea227-75c9-4197-83d4-7bb635d31e37 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:30.144484 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b92ea227-75c9-4197-83d4-7bb635d31e37 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:30.144995 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b92ea227-75c9-4197-83d4-7bb635d31e37 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:30.388688 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-7f25bba9-2664-4c5d-a935-ee662b4f7e11 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:30.404011 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-7f25bba9-2664-4c5d-a935-ee662b4f7e11 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae" status: 200 len: 1318 microversion: 2.1 time: 0.289543 May 26 16:43:30.406071 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 170/338] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:30 2022] GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae => generated 1318 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:30.408087 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b92ea227-75c9-4197-83d4-7bb635d31e37 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:30.415660 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-3fc1e957-8551-4f48-8e13-958edee47246 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:30.417172 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-3fc1e957-8551-4f48-8e13-958edee47246 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] [instance: e2f08adf-3dbf-4829-9761-dca0ea87c997] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:30.425091 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-b92ea227-75c9-4197-83d4-7bb635d31e37 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1524 microversion: 2.1 time: 0.302687 May 26 16:43:30.426610 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 169/339] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:30 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1524 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:43:30.430660 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3fc1e957-8551-4f48-8e13-958edee47246 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:30.431812 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3fc1e957-8551-4f48-8e13-958edee47246 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:30.433318 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3fc1e957-8551-4f48-8e13-958edee47246 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:30.434145 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3fc1e957-8551-4f48-8e13-958edee47246 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:30.529887 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-3fc1e957-8551-4f48-8e13-958edee47246 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67b0bec1d74cf1a07415665e782d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4d322cc014464da21503514cd08b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:30.538302 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-3fc1e957-8551-4f48-8e13-958edee47246 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] 10.222.0.102 "GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997" status: 200 len: 1222 microversion: 2.1 time: 0.130206 May 26 16:43:30.538777 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 171/340] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:30 2022] GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997 => generated 1222 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:31.423712 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-58801ba3-6267-4d8d-9279-39c843c4872f tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:31.424337 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-58801ba3-6267-4d8d-9279-39c843c4872f tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: a5423742-f6e7-40c5-98d6-50f28c3c18ae] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:31.432605 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-58801ba3-6267-4d8d-9279-39c843c4872f tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:31.433055 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-58801ba3-6267-4d8d-9279-39c843c4872f tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:31.433851 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-58801ba3-6267-4d8d-9279-39c843c4872f tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:31.434276 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-58801ba3-6267-4d8d-9279-39c843c4872f tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:31.450557 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-ca06deed-4eab-4d1b-b957-53abe23b07ab tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:31.451569 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-ca06deed-4eab-4d1b-b957-53abe23b07ab tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:31.462331 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ca06deed-4eab-4d1b-b957-53abe23b07ab tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:31.463127 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ca06deed-4eab-4d1b-b957-53abe23b07ab tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:31.464566 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ca06deed-4eab-4d1b-b957-53abe23b07ab tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:31.465388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ca06deed-4eab-4d1b-b957-53abe23b07ab tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:31.665060 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-58801ba3-6267-4d8d-9279-39c843c4872f tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:31.674085 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-58801ba3-6267-4d8d-9279-39c843c4872f tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae" status: 200 len: 1318 microversion: 2.1 time: 0.254300 May 26 16:43:31.674719 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 170/341] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:31 2022] GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:43:31.689690 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f8da42da-cac2-43c6-9501-ce0b7c045ef6 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:31.690314 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f8da42da-cac2-43c6-9501-ce0b7c045ef6 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] [instance: e2f08adf-3dbf-4829-9761-dca0ea87c997] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:31.698205 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f8da42da-cac2-43c6-9501-ce0b7c045ef6 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:31.698761 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f8da42da-cac2-43c6-9501-ce0b7c045ef6 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:31.699520 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-ca06deed-4eab-4d1b-b957-53abe23b07ab tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:31.699729 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f8da42da-cac2-43c6-9501-ce0b7c045ef6 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:31.700282 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f8da42da-cac2-43c6-9501-ce0b7c045ef6 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:31.713536 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-ca06deed-4eab-4d1b-b957-53abe23b07ab tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1524 microversion: 2.1 time: 0.270275 May 26 16:43:31.714564 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 172/342] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:31 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1524 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:43:31.772157 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f8da42da-cac2-43c6-9501-ce0b7c045ef6 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67b0bec1d74cf1a07415665e782d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4d322cc014464da21503514cd08b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:31.779988 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f8da42da-cac2-43c6-9501-ce0b7c045ef6 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] 10.222.0.102 "GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997" status: 200 len: 1222 microversion: 2.1 time: 0.094091 May 26 16:43:31.780620 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 171/343] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:31 2022] GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997 => generated 1222 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:32.697265 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-55638b21-7aa5-426c-8901-8989eb92ad3e tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:32.698425 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-55638b21-7aa5-426c-8901-8989eb92ad3e tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: a5423742-f6e7-40c5-98d6-50f28c3c18ae] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:32.709422 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-55638b21-7aa5-426c-8901-8989eb92ad3e tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:32.710222 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-55638b21-7aa5-426c-8901-8989eb92ad3e tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:32.712312 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-55638b21-7aa5-426c-8901-8989eb92ad3e tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:32.713143 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-55638b21-7aa5-426c-8901-8989eb92ad3e tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:32.735913 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-42aa368c-26cb-4ef9-b9ff-8ec864abd24c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:32.736976 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-42aa368c-26cb-4ef9-b9ff-8ec864abd24c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:32.748486 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-42aa368c-26cb-4ef9-b9ff-8ec864abd24c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:32.749471 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-42aa368c-26cb-4ef9-b9ff-8ec864abd24c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:32.751078 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-42aa368c-26cb-4ef9-b9ff-8ec864abd24c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:32.751819 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-42aa368c-26cb-4ef9-b9ff-8ec864abd24c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:32.993231 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-55638b21-7aa5-426c-8901-8989eb92ad3e tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:33.003387 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-55638b21-7aa5-426c-8901-8989eb92ad3e tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae" status: 200 len: 1318 microversion: 2.1 time: 0.314231 May 26 16:43:33.004349 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 173/344] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:32 2022] GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae => generated 1318 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:33.012852 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-0b68afb1-a364-4849-bed1-84a242e93b7d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:33.013684 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-0b68afb1-a364-4849-bed1-84a242e93b7d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] [instance: e2f08adf-3dbf-4829-9761-dca0ea87c997] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:33.022739 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0b68afb1-a364-4849-bed1-84a242e93b7d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:33.023510 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0b68afb1-a364-4849-bed1-84a242e93b7d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:33.025030 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0b68afb1-a364-4849-bed1-84a242e93b7d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:33.025789 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0b68afb1-a364-4849-bed1-84a242e93b7d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:33.048620 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-42aa368c-26cb-4ef9-b9ff-8ec864abd24c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:33.067664 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-42aa368c-26cb-4ef9-b9ff-8ec864abd24c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1524 microversion: 2.1 time: 0.338531 May 26 16:43:33.068797 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 172/345] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:32 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1524 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:43:33.139830 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-0b68afb1-a364-4849-bed1-84a242e93b7d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67b0bec1d74cf1a07415665e782d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4d322cc014464da21503514cd08b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:33.153362 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-0b68afb1-a364-4849-bed1-84a242e93b7d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] 10.222.0.102 "GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997" status: 200 len: 1222 microversion: 2.1 time: 0.146965 May 26 16:43:33.154066 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 174/346] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:33 2022] GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997 => generated 1222 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:34.022572 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ee2a2fa9-5b34-4d9d-8de6-e377018bc712 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:34.023322 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ee2a2fa9-5b34-4d9d-8de6-e377018bc712 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: a5423742-f6e7-40c5-98d6-50f28c3c18ae] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:34.026159 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:34.032923 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ee2a2fa9-5b34-4d9d-8de6-e377018bc712 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:34.033403 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ee2a2fa9-5b34-4d9d-8de6-e377018bc712 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:34.034194 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ee2a2fa9-5b34-4d9d-8de6-e377018bc712 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:34.034635 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ee2a2fa9-5b34-4d9d-8de6-e377018bc712 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:34.099498 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-f6618f21-3418-4fa2-81e9-ca857cf9366a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:34.101070 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-f6618f21-3418-4fa2-81e9-ca857cf9366a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:34.106886 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:34.117155 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f6618f21-3418-4fa2-81e9-ca857cf9366a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:34.118541 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f6618f21-3418-4fa2-81e9-ca857cf9366a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:34.120060 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f6618f21-3418-4fa2-81e9-ca857cf9366a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:34.120897 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f6618f21-3418-4fa2-81e9-ca857cf9366a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:34.245959 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ee2a2fa9-5b34-4d9d-8de6-e377018bc712 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:34.260219 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ee2a2fa9-5b34-4d9d-8de6-e377018bc712 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae" status: 200 len: 1318 microversion: 2.1 time: 0.241182 May 26 16:43:34.261126 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 173/347] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:34 2022] GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:34.267809 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d7065552-9a54-4935-9805-97232a1d8772 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:34.268614 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d7065552-9a54-4935-9805-97232a1d8772 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] [instance: e2f08adf-3dbf-4829-9761-dca0ea87c997] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:34.276228 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d7065552-9a54-4935-9805-97232a1d8772 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:34.276682 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d7065552-9a54-4935-9805-97232a1d8772 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:34.277467 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d7065552-9a54-4935-9805-97232a1d8772 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:34.277902 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d7065552-9a54-4935-9805-97232a1d8772 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:34.350293 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-f6618f21-3418-4fa2-81e9-ca857cf9366a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:34.359333 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-f6618f21-3418-4fa2-81e9-ca857cf9366a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1524 microversion: 2.1 time: 0.267219 May 26 16:43:34.360351 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 175/348] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:34 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1524 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:43:34.380870 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d7065552-9a54-4935-9805-97232a1d8772 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67b0bec1d74cf1a07415665e782d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4d322cc014464da21503514cd08b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:34.388607 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d7065552-9a54-4935-9805-97232a1d8772 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] 10.222.0.102 "GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997" status: 200 len: 1270 microversion: 2.1 time: 0.126109 May 26 16:43:34.389205 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 174/349] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:34 2022] GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997 => generated 1270 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:35.279982 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-a98eeca9-14a0-4853-8905-9395120c6ddb tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:35.280765 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-a98eeca9-14a0-4853-8905-9395120c6ddb tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: a5423742-f6e7-40c5-98d6-50f28c3c18ae] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:35.287367 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a98eeca9-14a0-4853-8905-9395120c6ddb tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:35.287703 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a98eeca9-14a0-4853-8905-9395120c6ddb tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:35.288519 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a98eeca9-14a0-4853-8905-9395120c6ddb tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:35.288955 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a98eeca9-14a0-4853-8905-9395120c6ddb tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:35.378812 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2d28f2f8-2288-4e57-b5aa-207ce0c8f210 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:35.379550 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2d28f2f8-2288-4e57-b5aa-207ce0c8f210 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:35.387734 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2d28f2f8-2288-4e57-b5aa-207ce0c8f210 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:35.388676 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2d28f2f8-2288-4e57-b5aa-207ce0c8f210 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:35.390163 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2d28f2f8-2288-4e57-b5aa-207ce0c8f210 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:35.390936 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2d28f2f8-2288-4e57-b5aa-207ce0c8f210 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:35.480431 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-a98eeca9-14a0-4853-8905-9395120c6ddb tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:35.489176 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-a98eeca9-14a0-4853-8905-9395120c6ddb tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae" status: 200 len: 1318 microversion: 2.1 time: 0.212986 May 26 16:43:35.489804 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 176/350] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:35 2022] GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:35.494866 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-99514e24-4de2-4646-9a20-01be5f6b1f69 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:35.495474 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-99514e24-4de2-4646-9a20-01be5f6b1f69 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] [instance: e2f08adf-3dbf-4829-9761-dca0ea87c997] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:35.502691 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-99514e24-4de2-4646-9a20-01be5f6b1f69 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:35.503181 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-99514e24-4de2-4646-9a20-01be5f6b1f69 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:35.503998 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-99514e24-4de2-4646-9a20-01be5f6b1f69 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:35.504471 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-99514e24-4de2-4646-9a20-01be5f6b1f69 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:35.566954 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:35.594786 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=8 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:35.614124 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-99514e24-4de2-4646-9a20-01be5f6b1f69 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67b0bec1d74cf1a07415665e782d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4d322cc014464da21503514cd08b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:35.624009 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-99514e24-4de2-4646-9a20-01be5f6b1f69 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] 10.222.0.102 "GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997" status: 200 len: 1270 microversion: 2.1 time: 0.132889 May 26 16:43:35.624924 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 177/351] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:35 2022] GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997 => generated 1270 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:35.670711 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-2d28f2f8-2288-4e57-b5aa-207ce0c8f210 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:35.681704 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2d28f2f8-2288-4e57-b5aa-207ce0c8f210 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1524 microversion: 2.1 time: 0.307034 May 26 16:43:35.682701 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 175/352] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:35 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1524 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:43:36.512191 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-7b85653f-4a85-4327-94aa-0311b7c277a0 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:36.513431 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-7b85653f-4a85-4327-94aa-0311b7c277a0 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: a5423742-f6e7-40c5-98d6-50f28c3c18ae] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:36.517020 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell0:SELECT=8 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:36.527751 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7b85653f-4a85-4327-94aa-0311b7c277a0 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:36.528594 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7b85653f-4a85-4327-94aa-0311b7c277a0 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:36.530144 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7b85653f-4a85-4327-94aa-0311b7c277a0 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:36.530987 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7b85653f-4a85-4327-94aa-0311b7c277a0 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:36.642439 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d95ceaaf-ee39-4380-98d0-d0d7262fceaa tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:36.643477 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d95ceaaf-ee39-4380-98d0-d0d7262fceaa tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] [instance: e2f08adf-3dbf-4829-9761-dca0ea87c997] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:36.655530 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d95ceaaf-ee39-4380-98d0-d0d7262fceaa tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:36.656121 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d95ceaaf-ee39-4380-98d0-d0d7262fceaa tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:36.657100 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d95ceaaf-ee39-4380-98d0-d0d7262fceaa tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:36.657618 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d95ceaaf-ee39-4380-98d0-d0d7262fceaa tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:36.738793 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d95ceaaf-ee39-4380-98d0-d0d7262fceaa tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67b0bec1d74cf1a07415665e782d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4d322cc014464da21503514cd08b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:36.745316 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-7b85653f-4a85-4327-94aa-0311b7c277a0 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:36.750786 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d95ceaaf-ee39-4380-98d0-d0d7262fceaa tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] 10.222.0.102 "GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997" status: 200 len: 1270 microversion: 2.1 time: 0.112027 May 26 16:43:36.752634 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 176/353] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:36 2022] GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997 => generated 1270 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:43:36.757354 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-7b85653f-4a85-4327-94aa-0311b7c277a0 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae" status: 200 len: 1318 microversion: 2.1 time: 0.252853 May 26 16:43:36.759191 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 178/354] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:36 2022] GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:36.763016 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1d794aa1-7d56-4858-a5f9-4a8db0eef3d5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:36.764067 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1d794aa1-7d56-4858-a5f9-4a8db0eef3d5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:36.772878 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1d794aa1-7d56-4858-a5f9-4a8db0eef3d5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:36.773381 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1d794aa1-7d56-4858-a5f9-4a8db0eef3d5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:36.774966 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1d794aa1-7d56-4858-a5f9-4a8db0eef3d5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:36.775448 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1d794aa1-7d56-4858-a5f9-4a8db0eef3d5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:36.925830 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1d794aa1-7d56-4858-a5f9-4a8db0eef3d5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:36.934815 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1d794aa1-7d56-4858-a5f9-4a8db0eef3d5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1524 microversion: 2.1 time: 0.180207 May 26 16:43:36.935419 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 177/355] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:36 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1524 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:37.775464 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-46b7aeed-5340-4f98-b767-eb17b2983c75 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:37.776246 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-46b7aeed-5340-4f98-b767-eb17b2983c75 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: a5423742-f6e7-40c5-98d6-50f28c3c18ae] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:37.777302 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-a53d1162-64e2-41bf-bbd5-6ce45ab739d2 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:37.778413 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-a53d1162-64e2-41bf-bbd5-6ce45ab739d2 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] [instance: e2f08adf-3dbf-4829-9761-dca0ea87c997] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:37.783324 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-46b7aeed-5340-4f98-b767-eb17b2983c75 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:37.783848 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-46b7aeed-5340-4f98-b767-eb17b2983c75 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:37.784750 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-46b7aeed-5340-4f98-b767-eb17b2983c75 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:37.785182 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-46b7aeed-5340-4f98-b767-eb17b2983c75 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:37.790751 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a53d1162-64e2-41bf-bbd5-6ce45ab739d2 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:37.791555 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a53d1162-64e2-41bf-bbd5-6ce45ab739d2 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:37.793012 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a53d1162-64e2-41bf-bbd5-6ce45ab739d2 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:37.793803 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a53d1162-64e2-41bf-bbd5-6ce45ab739d2 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:37.942428 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-a53d1162-64e2-41bf-bbd5-6ce45ab739d2 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67b0bec1d74cf1a07415665e782d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4d322cc014464da21503514cd08b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:37.966523 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-a53d1162-64e2-41bf-bbd5-6ce45ab739d2 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] 10.222.0.102 "GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997" status: 200 len: 1270 microversion: 2.1 time: 0.194497 May 26 16:43:37.981068 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 179/356] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:37 2022] GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997 => generated 1270 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:37.991630 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-888db78c-4e15-4cb2-bccc-2d26097e4006 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:37.993308 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-888db78c-4e15-4cb2-bccc-2d26097e4006 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:38.005940 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-888db78c-4e15-4cb2-bccc-2d26097e4006 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:38.007114 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-888db78c-4e15-4cb2-bccc-2d26097e4006 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:38.008985 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-888db78c-4e15-4cb2-bccc-2d26097e4006 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:38.010168 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-888db78c-4e15-4cb2-bccc-2d26097e4006 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:38.050920 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=100 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:38.120833 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-46b7aeed-5340-4f98-b767-eb17b2983c75 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:38.136524 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-46b7aeed-5340-4f98-b767-eb17b2983c75 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae" status: 200 len: 1318 microversion: 2.1 time: 0.364724 May 26 16:43:38.138050 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 178/357] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:37 2022] GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae => generated 1318 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:38.238920 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-888db78c-4e15-4cb2-bccc-2d26097e4006 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:38.247214 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-888db78c-4e15-4cb2-bccc-2d26097e4006 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1524 microversion: 2.1 time: 0.264854 May 26 16:43:38.247873 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 180/358] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:37 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1524 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:38.996833 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-07cb2392-3038-490f-86b1-b5eb775b190e tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:38.997888 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-07cb2392-3038-490f-86b1-b5eb775b190e tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] [instance: e2f08adf-3dbf-4829-9761-dca0ea87c997] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:39.005568 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-07cb2392-3038-490f-86b1-b5eb775b190e tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:39.006014 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-07cb2392-3038-490f-86b1-b5eb775b190e tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:39.006789 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-07cb2392-3038-490f-86b1-b5eb775b190e tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:39.007227 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-07cb2392-3038-490f-86b1-b5eb775b190e tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:39.023498 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=100 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:39.105793 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-07cb2392-3038-490f-86b1-b5eb775b190e tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67b0bec1d74cf1a07415665e782d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4d322cc014464da21503514cd08b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:39.120074 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-07cb2392-3038-490f-86b1-b5eb775b190e tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] 10.222.0.102 "GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997" status: 200 len: 1270 microversion: 2.1 time: 0.127960 May 26 16:43:39.122103 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 179/359] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:38 2022] GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997 => generated 1270 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:39.155128 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-20ccd65c-4b53-4f9d-9d15-037318233aa5 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:39.155802 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-20ccd65c-4b53-4f9d-9d15-037318233aa5 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: a5423742-f6e7-40c5-98d6-50f28c3c18ae] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:39.163270 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-20ccd65c-4b53-4f9d-9d15-037318233aa5 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:39.164103 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-20ccd65c-4b53-4f9d-9d15-037318233aa5 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:39.165431 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-20ccd65c-4b53-4f9d-9d15-037318233aa5 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:39.165964 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-20ccd65c-4b53-4f9d-9d15-037318233aa5 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:39.266785 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-76f4e786-71a8-4ce4-bd5c-214651eda0c3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:39.267833 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-76f4e786-71a8-4ce4-bd5c-214651eda0c3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:39.274763 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-76f4e786-71a8-4ce4-bd5c-214651eda0c3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:39.275319 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-76f4e786-71a8-4ce4-bd5c-214651eda0c3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:39.276222 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-76f4e786-71a8-4ce4-bd5c-214651eda0c3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:39.276937 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-76f4e786-71a8-4ce4-bd5c-214651eda0c3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:39.729603 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-20ccd65c-4b53-4f9d-9d15-037318233aa5 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:39.740214 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-20ccd65c-4b53-4f9d-9d15-037318233aa5 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae" status: 200 len: 1318 microversion: 2.1 time: 0.588940 May 26 16:43:39.740980 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 181/360] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:39 2022] GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae => generated 1318 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:39.787472 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-76f4e786-71a8-4ce4-bd5c-214651eda0c3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:39.797278 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-76f4e786-71a8-4ce4-bd5c-214651eda0c3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1524 microversion: 2.1 time: 0.534429 May 26 16:43:39.797971 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 180/361] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:39 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1524 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:43:40.143086 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-d4910bdf-0728-480a-8c58-0076d6959524 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:40.143987 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-d4910bdf-0728-480a-8c58-0076d6959524 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] [instance: e2f08adf-3dbf-4829-9761-dca0ea87c997] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:40.153332 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d4910bdf-0728-480a-8c58-0076d6959524 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:40.155048 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d4910bdf-0728-480a-8c58-0076d6959524 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:40.156167 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d4910bdf-0728-480a-8c58-0076d6959524 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:40.158368 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d4910bdf-0728-480a-8c58-0076d6959524 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:40.226281 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-b2d30a37-702e-48cf-9ec8-39af8f71cd25 req-9fbba6a8-1892-4fec-8f47-9a223b74017c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5423742-f6e7-40c5-98d6-50f28c3c18ae", "name": "network-vif-plugged", "status": "completed", "tag": "5fab6735-79e4-4e3b-8254-559430f3ce8a"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:43:40.245531 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-b2d30a37-702e-48cf-9ec8-39af8f71cd25 req-9fbba6a8-1892-4fec-8f47-9a223b74017c service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:40.246302 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-b2d30a37-702e-48cf-9ec8-39af8f71cd25 req-9fbba6a8-1892-4fec-8f47-9a223b74017c service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:40.261037 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-b2d30a37-702e-48cf-9ec8-39af8f71cd25 req-9fbba6a8-1892-4fec-8f47-9a223b74017c service nova] Creating event network-vif-plugged:5fab6735-79e4-4e3b-8254-559430f3ce8a for instance a5423742-f6e7-40c5-98d6-50f28c3c18ae on hv-cinder-83607 May 26 16:43:40.266838 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-b2d30a37-702e-48cf-9ec8-39af8f71cd25 req-9fbba6a8-1892-4fec-8f47-9a223b74017c service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053397 May 26 16:43:40.268079 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 181/362] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:43:40.279455 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-d4910bdf-0728-480a-8c58-0076d6959524 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67b0bec1d74cf1a07415665e782d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4d322cc014464da21503514cd08b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:40.294474 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-d4910bdf-0728-480a-8c58-0076d6959524 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] 10.222.0.102 "GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997" status: 200 len: 1276 microversion: 2.1 time: 0.155573 May 26 16:43:40.295575 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 182/363] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:40 2022] GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997 => generated 1276 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:40.766589 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-92177f7d-693d-4ec0-91b9-69c4a566cc34 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:40.767912 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-92177f7d-693d-4ec0-91b9-69c4a566cc34 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: a5423742-f6e7-40c5-98d6-50f28c3c18ae] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:40.777796 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-92177f7d-693d-4ec0-91b9-69c4a566cc34 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:40.778927 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-92177f7d-693d-4ec0-91b9-69c4a566cc34 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:40.780220 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-92177f7d-693d-4ec0-91b9-69c4a566cc34 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:40.781556 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-92177f7d-693d-4ec0-91b9-69c4a566cc34 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:40.824564 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-4811f6d9-d058-4e0a-b475-3e633bd83461 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:40.825694 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-4811f6d9-d058-4e0a-b475-3e633bd83461 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:40.832840 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4811f6d9-d058-4e0a-b475-3e633bd83461 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:40.833612 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4811f6d9-d058-4e0a-b475-3e633bd83461 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:40.834799 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4811f6d9-d058-4e0a-b475-3e633bd83461 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:40.844902 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4811f6d9-d058-4e0a-b475-3e633bd83461 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:41.093767 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-92177f7d-693d-4ec0-91b9-69c4a566cc34 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:41.104023 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-4811f6d9-d058-4e0a-b475-3e633bd83461 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:41.112830 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-92177f7d-693d-4ec0-91b9-69c4a566cc34 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae" status: 200 len: 1318 microversion: 2.1 time: 0.353033 May 26 16:43:41.122893 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 182/364] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:40 2022] GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae => generated 1318 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:41.122981 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-4811f6d9-d058-4e0a-b475-3e633bd83461 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1524 microversion: 2.1 time: 0.299663 May 26 16:43:41.122981 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 183/365] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:40 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1524 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:41.321810 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-b361b327-9b8a-4050-a041-7d8074a17baa tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:41.323274 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-b361b327-9b8a-4050-a041-7d8074a17baa tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] [instance: e2f08adf-3dbf-4829-9761-dca0ea87c997] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:41.334762 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b361b327-9b8a-4050-a041-7d8074a17baa tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:41.335693 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b361b327-9b8a-4050-a041-7d8074a17baa tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:41.337784 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b361b327-9b8a-4050-a041-7d8074a17baa tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:41.338706 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b361b327-9b8a-4050-a041-7d8074a17baa tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:41.561197 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b361b327-9b8a-4050-a041-7d8074a17baa tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67b0bec1d74cf1a07415665e782d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4d322cc014464da21503514cd08b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:41.571490 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-b361b327-9b8a-4050-a041-7d8074a17baa tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] 10.222.0.102 "GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997" status: 200 len: 1318 microversion: 2.1 time: 0.260352 May 26 16:43:41.572188 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 183/366] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:41 2022] GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:42.147202 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-7cc3da04-0c28-47e2-828d-4b03bf464b19 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:42.148409 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-7cc3da04-0c28-47e2-828d-4b03bf464b19 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: a5423742-f6e7-40c5-98d6-50f28c3c18ae] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:42.153258 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d3c64665-cac6-4147-a32d-487bdb995ffe tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:42.154100 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d3c64665-cac6-4147-a32d-487bdb995ffe tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:42.163280 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7cc3da04-0c28-47e2-828d-4b03bf464b19 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:42.163727 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7cc3da04-0c28-47e2-828d-4b03bf464b19 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:42.164702 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d3c64665-cac6-4147-a32d-487bdb995ffe tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:42.164913 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7cc3da04-0c28-47e2-828d-4b03bf464b19 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:42.165182 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7cc3da04-0c28-47e2-828d-4b03bf464b19 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:42.165435 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d3c64665-cac6-4147-a32d-487bdb995ffe tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:42.166447 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d3c64665-cac6-4147-a32d-487bdb995ffe tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:42.167143 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d3c64665-cac6-4147-a32d-487bdb995ffe tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:42.508891 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-7cc3da04-0c28-47e2-828d-4b03bf464b19 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:42.525672 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-7cc3da04-0c28-47e2-828d-4b03bf464b19 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae" status: 200 len: 1318 microversion: 2.1 time: 0.397595 May 26 16:43:42.526694 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 184/367] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:42 2022] GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae => generated 1318 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:42.544273 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d3c64665-cac6-4147-a32d-487bdb995ffe tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:42.557010 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d3c64665-cac6-4147-a32d-487bdb995ffe tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1524 microversion: 2.1 time: 0.419632 May 26 16:43:42.557816 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 184/368] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:42 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1524 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:42.601077 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-e4ef7e60-e62c-449a-9389-6ba1e2102c3d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:42.602976 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-e4ef7e60-e62c-449a-9389-6ba1e2102c3d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] [instance: e2f08adf-3dbf-4829-9761-dca0ea87c997] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:42.612453 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e4ef7e60-e62c-449a-9389-6ba1e2102c3d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:42.613082 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e4ef7e60-e62c-449a-9389-6ba1e2102c3d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:42.614092 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e4ef7e60-e62c-449a-9389-6ba1e2102c3d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:42.614659 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e4ef7e60-e62c-449a-9389-6ba1e2102c3d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:42.739322 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-81737362-71fc-4211-969d-826219ea68b8 req-5ad3471e-2348-44cc-8c7b-8c6fdf330a19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2f08adf-3dbf-4829-9761-dca0ea87c997", "tag": "a4a5aad8-cdec-4c14-a2b1-becfdaa53637"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:43:42.753617 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-81737362-71fc-4211-969d-826219ea68b8 req-5ad3471e-2348-44cc-8c7b-8c6fdf330a19 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:42.754415 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-81737362-71fc-4211-969d-826219ea68b8 req-5ad3471e-2348-44cc-8c7b-8c6fdf330a19 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:42.775610 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-81737362-71fc-4211-969d-826219ea68b8 req-5ad3471e-2348-44cc-8c7b-8c6fdf330a19 service nova] Creating event network-changed:a4a5aad8-cdec-4c14-a2b1-becfdaa53637 for instance e2f08adf-3dbf-4829-9761-dca0ea87c997 on hv-cinder-83607 May 26 16:43:42.786031 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-81737362-71fc-4211-969d-826219ea68b8 req-5ad3471e-2348-44cc-8c7b-8c6fdf330a19 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050708 May 26 16:43:42.788015 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 185/369] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:43:42.939529 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-e4ef7e60-e62c-449a-9389-6ba1e2102c3d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67b0bec1d74cf1a07415665e782d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4d322cc014464da21503514cd08b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:42.955387 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-e4ef7e60-e62c-449a-9389-6ba1e2102c3d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] 10.222.0.102 "GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997" status: 200 len: 1318 microversion: 2.1 time: 0.362415 May 26 16:43:42.960497 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 185/370] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:42 2022] GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997 => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:43:43.551846 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-83fa9103-c0ec-40ad-be87-ab111b18b955 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:43.552669 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-83fa9103-c0ec-40ad-be87-ab111b18b955 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: a5423742-f6e7-40c5-98d6-50f28c3c18ae] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:43.560855 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-83fa9103-c0ec-40ad-be87-ab111b18b955 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:43.561504 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-83fa9103-c0ec-40ad-be87-ab111b18b955 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:43.562360 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-83fa9103-c0ec-40ad-be87-ab111b18b955 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:43.562843 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-83fa9103-c0ec-40ad-be87-ab111b18b955 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:43.580181 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-94528ac9-4a60-416e-be0a-40d06ffcde5c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:43.581260 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-94528ac9-4a60-416e-be0a-40d06ffcde5c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:43.591522 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-94528ac9-4a60-416e-be0a-40d06ffcde5c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:43.592247 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-94528ac9-4a60-416e-be0a-40d06ffcde5c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:43.593374 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-94528ac9-4a60-416e-be0a-40d06ffcde5c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:43.593924 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-94528ac9-4a60-416e-be0a-40d06ffcde5c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:43.964069 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-83fa9103-c0ec-40ad-be87-ab111b18b955 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:43.981572 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-83fa9103-c0ec-40ad-be87-ab111b18b955 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae" status: 200 len: 1501 microversion: 2.1 time: 0.433794 May 26 16:43:43.985297 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 186/371] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:43 2022] GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae => generated 1501 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:43.997520 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-4169a57d-dddb-4da1-a307-d3e597283594 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:43.999143 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-4169a57d-dddb-4da1-a307-d3e597283594 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] [instance: e2f08adf-3dbf-4829-9761-dca0ea87c997] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:44.014059 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4169a57d-dddb-4da1-a307-d3e597283594 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:44.014807 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4169a57d-dddb-4da1-a307-d3e597283594 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:44.016164 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4169a57d-dddb-4da1-a307-d3e597283594 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:44.017426 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4169a57d-dddb-4da1-a307-d3e597283594 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:44.393291 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-94528ac9-4a60-416e-be0a-40d06ffcde5c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:44.412428 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-94528ac9-4a60-416e-be0a-40d06ffcde5c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1524 microversion: 2.1 time: 0.838764 May 26 16:43:44.417628 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 186/372] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:43 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1524 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:43:44.702181 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-4169a57d-dddb-4da1-a307-d3e597283594 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67b0bec1d74cf1a07415665e782d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4d322cc014464da21503514cd08b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:44.713508 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-4169a57d-dddb-4da1-a307-d3e597283594 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] 10.222.0.102 "GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997" status: 200 len: 1318 microversion: 2.1 time: 0.725650 May 26 16:43:44.714270 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 187/373] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:43 2022] GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997 => generated 1318 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:44.876335 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-925ff16f-cc8e-4455-9403-ab61b779b6e2 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:44.877098 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-925ff16f-cc8e-4455-9403-ab61b779b6e2 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: a5423742-f6e7-40c5-98d6-50f28c3c18ae] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:44.890258 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-925ff16f-cc8e-4455-9403-ab61b779b6e2 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:44.891328 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-925ff16f-cc8e-4455-9403-ab61b779b6e2 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:44.892576 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-925ff16f-cc8e-4455-9403-ab61b779b6e2 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:44.893250 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-925ff16f-cc8e-4455-9403-ab61b779b6e2 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:44.946339 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-925ff16f-cc8e-4455-9403-ab61b779b6e2 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: a5423742-f6e7-40c5-98d6-50f28c3c18ae] Going to try to terminate instance {{(pid=124267) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 16:43:45.055502 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-925ff16f-cc8e-4455-9403-ab61b779b6e2 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "DELETE /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae" status: 204 len: 0 microversion: 2.1 time: 0.182326 May 26 16:43:45.056509 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 187/374] 10.222.0.102 () {58 vars in 1243 bytes} [Thu May 26 16:43:44 2022] DELETE /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 16:43:45.069419 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f1257059-5e7b-4c77-bab9-efd08bb41d10 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:45.071475 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f1257059-5e7b-4c77-bab9-efd08bb41d10 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: a5423742-f6e7-40c5-98d6-50f28c3c18ae] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:45.082255 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f1257059-5e7b-4c77-bab9-efd08bb41d10 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:45.082843 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f1257059-5e7b-4c77-bab9-efd08bb41d10 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:45.084170 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f1257059-5e7b-4c77-bab9-efd08bb41d10 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:45.084973 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f1257059-5e7b-4c77-bab9-efd08bb41d10 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:45.265349 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f1257059-5e7b-4c77-bab9-efd08bb41d10 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:45.273671 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f1257059-5e7b-4c77-bab9-efd08bb41d10 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae" status: 200 len: 1507 microversion: 2.1 time: 0.210356 May 26 16:43:45.274634 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 188/375] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:45 2022] GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae => generated 1507 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:45.433556 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-55f06156-b798-4321-a1d7-dc9416adff4a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:45.434267 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-55f06156-b798-4321-a1d7-dc9416adff4a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:45.442205 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-55f06156-b798-4321-a1d7-dc9416adff4a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:45.442652 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-55f06156-b798-4321-a1d7-dc9416adff4a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:45.443489 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-55f06156-b798-4321-a1d7-dc9416adff4a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:45.443927 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-55f06156-b798-4321-a1d7-dc9416adff4a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:45.623065 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-55f06156-b798-4321-a1d7-dc9416adff4a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:45.638580 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-55f06156-b798-4321-a1d7-dc9416adff4a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1524 microversion: 2.1 time: 0.210633 May 26 16:43:45.639764 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 188/376] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:45 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1524 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:45.739442 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e6565100-2cbe-46e8-a85f-d7ac8a0e881b tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:45.740242 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e6565100-2cbe-46e8-a85f-d7ac8a0e881b tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] [instance: e2f08adf-3dbf-4829-9761-dca0ea87c997] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:45.750393 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e6565100-2cbe-46e8-a85f-d7ac8a0e881b tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:45.751061 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e6565100-2cbe-46e8-a85f-d7ac8a0e881b tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:45.752226 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e6565100-2cbe-46e8-a85f-d7ac8a0e881b tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:45.752961 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e6565100-2cbe-46e8-a85f-d7ac8a0e881b tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:45.923023 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e6565100-2cbe-46e8-a85f-d7ac8a0e881b tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67b0bec1d74cf1a07415665e782d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4d322cc014464da21503514cd08b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:45.933073 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e6565100-2cbe-46e8-a85f-d7ac8a0e881b tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] 10.222.0.102 "GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997" status: 200 len: 1318 microversion: 2.1 time: 0.198576 May 26 16:43:45.933855 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 189/377] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:45 2022] GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:46.299603 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-ed0e536c-14a7-4396-93d7-5254dec7f344 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:46.300291 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-ed0e536c-14a7-4396-93d7-5254dec7f344 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: a5423742-f6e7-40c5-98d6-50f28c3c18ae] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:46.307438 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ed0e536c-14a7-4396-93d7-5254dec7f344 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:46.307899 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ed0e536c-14a7-4396-93d7-5254dec7f344 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:46.308728 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ed0e536c-14a7-4396-93d7-5254dec7f344 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:46.309174 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ed0e536c-14a7-4396-93d7-5254dec7f344 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:46.506983 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-ed0e536c-14a7-4396-93d7-5254dec7f344 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:46.518840 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-ed0e536c-14a7-4396-93d7-5254dec7f344 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae" status: 200 len: 1507 microversion: 2.1 time: 0.223396 May 26 16:43:46.519452 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 189/378] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:46 2022] GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae => generated 1507 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:46.666860 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7aaae8e2-afb3-4015-82bd-9d7a3e53f919 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:46.667456 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-7aaae8e2-afb3-4015-82bd-9d7a3e53f919 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:46.676163 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7aaae8e2-afb3-4015-82bd-9d7a3e53f919 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:46.676913 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7aaae8e2-afb3-4015-82bd-9d7a3e53f919 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:46.678260 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7aaae8e2-afb3-4015-82bd-9d7a3e53f919 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:46.678977 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7aaae8e2-afb3-4015-82bd-9d7a3e53f919 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:46.851011 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7aaae8e2-afb3-4015-82bd-9d7a3e53f919 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:46.859906 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7aaae8e2-afb3-4015-82bd-9d7a3e53f919 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1524 microversion: 2.1 time: 0.199532 May 26 16:43:46.860727 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 190/379] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:46 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1524 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:46.952315 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-8c78cf9a-6daf-4787-b366-260895c74ad8 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:46.953102 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-8c78cf9a-6daf-4787-b366-260895c74ad8 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] [instance: e2f08adf-3dbf-4829-9761-dca0ea87c997] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:46.961986 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8c78cf9a-6daf-4787-b366-260895c74ad8 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:46.962435 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8c78cf9a-6daf-4787-b366-260895c74ad8 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:46.963446 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8c78cf9a-6daf-4787-b366-260895c74ad8 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:46.963885 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8c78cf9a-6daf-4787-b366-260895c74ad8 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:47.126965 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-8c78cf9a-6daf-4787-b366-260895c74ad8 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67b0bec1d74cf1a07415665e782d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4d322cc014464da21503514cd08b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:47.135806 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-8c78cf9a-6daf-4787-b366-260895c74ad8 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] 10.222.0.102 "GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997" status: 200 len: 1318 microversion: 2.1 time: 0.187991 May 26 16:43:47.136427 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 190/380] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:46 2022] GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:47.547257 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-c1272821-4c59-4577-8041-f16c5ba628a9 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:47.548078 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-c1272821-4c59-4577-8041-f16c5ba628a9 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: a5423742-f6e7-40c5-98d6-50f28c3c18ae] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:47.555053 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c1272821-4c59-4577-8041-f16c5ba628a9 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:47.555564 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c1272821-4c59-4577-8041-f16c5ba628a9 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:47.556343 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c1272821-4c59-4577-8041-f16c5ba628a9 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:47.556807 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c1272821-4c59-4577-8041-f16c5ba628a9 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:47.762324 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c1272821-4c59-4577-8041-f16c5ba628a9 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:47.774566 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-c1272821-4c59-4577-8041-f16c5ba628a9 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae" status: 200 len: 1507 microversion: 2.1 time: 0.231161 May 26 16:43:47.775547 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 191/381] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:47 2022] GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae => generated 1507 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:47.878871 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-48749e4c-f9bf-42d6-8384-e2ce8add48d3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:47.879810 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-48749e4c-f9bf-42d6-8384-e2ce8add48d3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:47.886894 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-48749e4c-f9bf-42d6-8384-e2ce8add48d3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:47.887453 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-48749e4c-f9bf-42d6-8384-e2ce8add48d3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:47.888548 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-48749e4c-f9bf-42d6-8384-e2ce8add48d3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:47.889101 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-48749e4c-f9bf-42d6-8384-e2ce8add48d3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:48.050712 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-48749e4c-f9bf-42d6-8384-e2ce8add48d3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:48.059964 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-48749e4c-f9bf-42d6-8384-e2ce8add48d3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1524 microversion: 2.1 time: 0.185322 May 26 16:43:48.060762 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 191/382] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:47 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1524 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:48.153944 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a87fea63-0764-42c0-bc4a-5404e79b5993 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:48.154542 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a87fea63-0764-42c0-bc4a-5404e79b5993 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] [instance: e2f08adf-3dbf-4829-9761-dca0ea87c997] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:48.161413 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a87fea63-0764-42c0-bc4a-5404e79b5993 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:48.161862 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a87fea63-0764-42c0-bc4a-5404e79b5993 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:48.162644 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a87fea63-0764-42c0-bc4a-5404e79b5993 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:48.163077 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a87fea63-0764-42c0-bc4a-5404e79b5993 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:48.335036 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a87fea63-0764-42c0-bc4a-5404e79b5993 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67b0bec1d74cf1a07415665e782d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4d322cc014464da21503514cd08b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:48.350114 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a87fea63-0764-42c0-bc4a-5404e79b5993 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] 10.222.0.102 "GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997" status: 200 len: 1318 microversion: 2.1 time: 0.199849 May 26 16:43:48.351210 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 192/383] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:48 2022] GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:43:48.792855 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-57e985d2-1721-45ee-ba96-a0656786b234 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:48.793518 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-57e985d2-1721-45ee-ba96-a0656786b234 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: a5423742-f6e7-40c5-98d6-50f28c3c18ae] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:48.800260 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-57e985d2-1721-45ee-ba96-a0656786b234 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:48.800928 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-57e985d2-1721-45ee-ba96-a0656786b234 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:48.801747 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-57e985d2-1721-45ee-ba96-a0656786b234 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:48.802183 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-57e985d2-1721-45ee-ba96-a0656786b234 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:48.962644 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-57e985d2-1721-45ee-ba96-a0656786b234 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:48.973389 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-57e985d2-1721-45ee-ba96-a0656786b234 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae" status: 200 len: 1507 microversion: 2.1 time: 0.184568 May 26 16:43:48.974103 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 192/384] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:48 2022] GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae => generated 1507 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:49.079480 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-fb777948-d27f-4e39-be80-70c36c045bf3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:49.080175 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-fb777948-d27f-4e39-be80-70c36c045bf3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:49.088319 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fb777948-d27f-4e39-be80-70c36c045bf3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:49.088831 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fb777948-d27f-4e39-be80-70c36c045bf3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:49.089617 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fb777948-d27f-4e39-be80-70c36c045bf3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:49.090075 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fb777948-d27f-4e39-be80-70c36c045bf3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:49.245452 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-fb777948-d27f-4e39-be80-70c36c045bf3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:49.253865 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-fb777948-d27f-4e39-be80-70c36c045bf3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1524 microversion: 2.1 time: 0.178475 May 26 16:43:49.254531 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 193/385] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:49 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1524 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:49.375141 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-a0ce28e4-93cd-4adc-bdb0-e315fced4a4e tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:49.375624 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-a0ce28e4-93cd-4adc-bdb0-e315fced4a4e tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] [instance: e2f08adf-3dbf-4829-9761-dca0ea87c997] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:49.382282 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a0ce28e4-93cd-4adc-bdb0-e315fced4a4e tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:49.382732 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a0ce28e4-93cd-4adc-bdb0-e315fced4a4e tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:49.383517 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a0ce28e4-93cd-4adc-bdb0-e315fced4a4e tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:49.383959 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a0ce28e4-93cd-4adc-bdb0-e315fced4a4e tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:49.538835 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-a0ce28e4-93cd-4adc-bdb0-e315fced4a4e tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67b0bec1d74cf1a07415665e782d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4d322cc014464da21503514cd08b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:49.551320 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-a0ce28e4-93cd-4adc-bdb0-e315fced4a4e tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] 10.222.0.102 "GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997" status: 200 len: 1318 microversion: 2.1 time: 0.180056 May 26 16:43:49.552025 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 193/386] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:49 2022] GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:49.993797 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-bc4d66ec-68ea-4fc3-ac18-49d863e8c801 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:49.994667 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-bc4d66ec-68ea-4fc3-ac18-49d863e8c801 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: a5423742-f6e7-40c5-98d6-50f28c3c18ae] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:50.006080 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bc4d66ec-68ea-4fc3-ac18-49d863e8c801 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:50.006804 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bc4d66ec-68ea-4fc3-ac18-49d863e8c801 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:50.008888 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bc4d66ec-68ea-4fc3-ac18-49d863e8c801 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:50.009495 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bc4d66ec-68ea-4fc3-ac18-49d863e8c801 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:50.272288 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-1b3ff4ea-25c7-4e09-b117-1e338e31ee3a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:50.273748 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-1b3ff4ea-25c7-4e09-b117-1e338e31ee3a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:50.280552 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1b3ff4ea-25c7-4e09-b117-1e338e31ee3a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:50.281385 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1b3ff4ea-25c7-4e09-b117-1e338e31ee3a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:50.282406 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1b3ff4ea-25c7-4e09-b117-1e338e31ee3a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:50.283036 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1b3ff4ea-25c7-4e09-b117-1e338e31ee3a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:50.289105 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-bc4d66ec-68ea-4fc3-ac18-49d863e8c801 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:50.316765 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-bc4d66ec-68ea-4fc3-ac18-49d863e8c801 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae" status: 200 len: 1507 microversion: 2.1 time: 0.327631 May 26 16:43:50.317709 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 194/387] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:49 2022] GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae => generated 1507 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:50.491913 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-1b3ff4ea-25c7-4e09-b117-1e338e31ee3a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:50.500899 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-1b3ff4ea-25c7-4e09-b117-1e338e31ee3a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1524 microversion: 2.1 time: 0.232480 May 26 16:43:50.501534 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 194/388] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:50 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1524 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:43:50.569771 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-68d62499-441c-4563-96fe-8fe5294354df tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:50.570447 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-68d62499-441c-4563-96fe-8fe5294354df tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] [instance: e2f08adf-3dbf-4829-9761-dca0ea87c997] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:50.577700 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-68d62499-441c-4563-96fe-8fe5294354df tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:50.578152 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-68d62499-441c-4563-96fe-8fe5294354df tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:50.578950 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-68d62499-441c-4563-96fe-8fe5294354df tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:50.579390 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-68d62499-441c-4563-96fe-8fe5294354df tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:50.819940 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-68d62499-441c-4563-96fe-8fe5294354df tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67b0bec1d74cf1a07415665e782d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4d322cc014464da21503514cd08b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:50.836902 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-68d62499-441c-4563-96fe-8fe5294354df tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] 10.222.0.102 "GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997" status: 200 len: 1318 microversion: 2.1 time: 0.270409 May 26 16:43:50.838170 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 195/389] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:50 2022] GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997 => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:51.340295 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-64d0fee6-359b-4dfd-bd3b-94909a0629fc tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:51.341420 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-64d0fee6-359b-4dfd-bd3b-94909a0629fc tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: a5423742-f6e7-40c5-98d6-50f28c3c18ae] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:51.353783 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-64d0fee6-359b-4dfd-bd3b-94909a0629fc tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:51.355068 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-64d0fee6-359b-4dfd-bd3b-94909a0629fc tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:51.355894 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-64d0fee6-359b-4dfd-bd3b-94909a0629fc tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:51.356904 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-64d0fee6-359b-4dfd-bd3b-94909a0629fc tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:51.389039 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:51.525684 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6d09e856-66d8-472f-9002-f7e31843f82d tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:51.527094 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-6d09e856-66d8-472f-9002-f7e31843f82d tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:51.536957 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6d09e856-66d8-472f-9002-f7e31843f82d tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:51.537703 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6d09e856-66d8-472f-9002-f7e31843f82d tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:51.539718 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6d09e856-66d8-472f-9002-f7e31843f82d tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:51.540280 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6d09e856-66d8-472f-9002-f7e31843f82d tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:51.617836 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-64d0fee6-359b-4dfd-bd3b-94909a0629fc tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0fb73a262843f89285a6e161a1abed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f81bd02cdf94ff98c1e9534199b425c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:51.624953 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-64d0fee6-359b-4dfd-bd3b-94909a0629fc tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae" status: 200 len: 1507 microversion: 2.1 time: 0.292900 May 26 16:43:51.625538 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 195/390] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:51 2022] GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae => generated 1507 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:51.750298 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-26ee5322-383f-413e-a599-75a23a30de6d req-a02663d0-874c-4ac3-b461-882d07f571b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5423742-f6e7-40c5-98d6-50f28c3c18ae", "name": "network-vif-deleted", "tag": "5fab6735-79e4-4e3b-8254-559430f3ce8a"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:43:51.765466 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-26ee5322-383f-413e-a599-75a23a30de6d req-a02663d0-874c-4ac3-b461-882d07f571b9 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:51.766236 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-26ee5322-383f-413e-a599-75a23a30de6d req-a02663d0-874c-4ac3-b461-882d07f571b9 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:51.776205 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6d09e856-66d8-472f-9002-f7e31843f82d tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:51.784398 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-26ee5322-383f-413e-a599-75a23a30de6d req-a02663d0-874c-4ac3-b461-882d07f571b9 service nova] Creating event network-vif-deleted:5fab6735-79e4-4e3b-8254-559430f3ce8a for instance a5423742-f6e7-40c5-98d6-50f28c3c18ae on hv-cinder-83607 May 26 16:43:51.785204 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6d09e856-66d8-472f-9002-f7e31843f82d tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1524 microversion: 2.1 time: 0.264110 May 26 16:43:51.785795 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 196/391] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:51 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1524 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:43:51.789774 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-26ee5322-383f-413e-a599-75a23a30de6d req-a02663d0-874c-4ac3-b461-882d07f571b9 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045383 May 26 16:43:51.790373 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 196/392] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:43:51.854851 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-fab77e65-cf60-42e2-b8c7-df87ebeec3d6 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:51.855580 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-fab77e65-cf60-42e2-b8c7-df87ebeec3d6 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] [instance: e2f08adf-3dbf-4829-9761-dca0ea87c997] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:51.862829 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fab77e65-cf60-42e2-b8c7-df87ebeec3d6 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:51.863253 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fab77e65-cf60-42e2-b8c7-df87ebeec3d6 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:51.864242 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fab77e65-cf60-42e2-b8c7-df87ebeec3d6 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:51.864869 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fab77e65-cf60-42e2-b8c7-df87ebeec3d6 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:51.881238 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=100 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:52.007246 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-fab77e65-cf60-42e2-b8c7-df87ebeec3d6 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67b0bec1d74cf1a07415665e782d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4d322cc014464da21503514cd08b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:52.015587 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-fab77e65-cf60-42e2-b8c7-df87ebeec3d6 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] 10.222.0.102 "GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997" status: 200 len: 1318 microversion: 2.1 time: 0.164702 May 26 16:43:52.016158 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 197/393] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:51 2022] GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:43:52.643155 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-ba091201-2dae-4888-8f2d-c3d08828d494 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:52.644061 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-ba091201-2dae-4888-8f2d-c3d08828d494 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] [instance: a5423742-f6e7-40c5-98d6-50f28c3c18ae] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:52.651379 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ba091201-2dae-4888-8f2d-c3d08828d494 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:52.652111 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ba091201-2dae-4888-8f2d-c3d08828d494 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:52.653132 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ba091201-2dae-4888-8f2d-c3d08828d494 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:52.653569 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ba091201-2dae-4888-8f2d-c3d08828d494 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:52.677089 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.wsgi [None req-ba091201-2dae-4888-8f2d-c3d08828d494 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] HTTP exception thrown: Instance a5423742-f6e7-40c5-98d6-50f28c3c18ae could not be found. May 26 16:43:52.682142 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-ba091201-2dae-4888-8f2d-c3d08828d494 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Request method failure captured: May 26 16:43:52.682142 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: request: GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae HTTP/1.1 May 26 16:43:52.682142 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept: application/json May 26 16:43:52.682142 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept-Encoding: identity May 26 16:43:52.682142 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Connection: close May 26 16:43:52.682142 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Length: 0 May 26 16:43:52.682142 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Type: application/json May 26 16:43:52.682142 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Host: 10.222.0.102 May 26 16:43:52.682142 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Openstack-System-Scope: None May 26 16:43:52.682142 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: User-Agent: python-urllib3/1.26.9 May 26 16:43:52.682142 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Auth-Token: gAAAAABij631iL0b9u0DjlSfbPtObZdXB_e2n5baM7L-v1WB5bMbW9OeL5HFoPIemnAUzoIxF8onqAqpINSa7ciCDeHBGvN4qhy_t5OwIfBQFdy4IIDmC-KzjcINQa7_vdFCdIRZ7SaKGSoXtxLwu9vFj-DkyrWig9MXe7yI7yxHjcJuXtvYJZU May 26 16:43:52.682142 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Id: None May 26 16:43:52.682142 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Name: None May 26 16:43:52.682142 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Identity-Status: Confirmed May 26 16:43:52.682142 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Is-Admin-Project: True May 26 16:43:52.682142 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Id: default May 26 16:43:52.682142 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Name: Default May 26 16:43:52.682142 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Id: 9f81bd02cdf94ff98c1e9534199b425c May 26 16:43:52.682142 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Name: tempest-VolumesActionsTest-980100776 May 26 16:43:52.682142 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Role: reader,member May 26 16:43:52.682142 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Roles: reader,member May 26 16:43:52.683651 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/9f81bd02cdf94ff98c1e9534199b425c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/9f81bd02cdf94ff98c1e9534199b425c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/9f81bd02cdf94ff98c1e9534199b425c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_9f81bd02cdf94ff98c1e9534199b425c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:43:52.683651 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant: tempest-VolumesActionsTest-980100776 May 26 16:43:52.683651 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Id: 9f81bd02cdf94ff98c1e9534199b425c May 26 16:43:52.683651 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Name: tempest-VolumesActionsTest-980100776 May 26 16:43:52.683651 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User: tempest-VolumesActionsTest-980100776-project May 26 16:43:52.683651 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Id: default May 26 16:43:52.683651 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Name: Default May 26 16:43:52.683651 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Id: 9c0fb73a262843f89285a6e161a1abed May 26 16:43:52.683651 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Name: tempest-VolumesActionsTest-980100776-project May 26 16:43:52.683651 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: method: > May 26 16:43:52.683651 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: exception: Instance a5423742-f6e7-40c5-98d6-50f28c3c18ae could not be found. May 26 16:43:52.683651 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: action_args: {'id': 'a5423742-f6e7-40c5-98d6-50f28c3c18ae'} May 26 16:43:52.684525 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:43:52.684525 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:43:52.684525 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:43:52.684525 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:43:52.684525 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:43:52.684525 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:43:52.684525 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:43:52.684525 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:43:52.684525 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:43:52.684525 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:43:52.684525 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5423742-f6e7-40c5-98d6-50f28c3c18ae could not be found. May 26 16:43:52.684525 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:43:52.684525 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:43:52.684525 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:43:52.684525 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:43:52.684525 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:43:52.684525 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:43:52.684525 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:43:52.684525 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:43:52.684525 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:43:52.686644 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:43:52.686644 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 16:43:52.686644 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 16:43:52.686644 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:43:52.686644 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:43:52.686644 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:43:52.686644 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:43:52.686644 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5423742-f6e7-40c5-98d6-50f28c3c18ae could not be found. May 26 16:43:52.686644 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:43:52.686644 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:43:52.686644 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:43:52.686644 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:43:52.686644 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:43:52.686644 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:43:52.686644 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:43:52.686644 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:43:52.686644 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5423742-f6e7-40c5-98d6-50f28c3c18ae could not be found. May 26 16:43:52.686644 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:43:52.687798 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-ba091201-2dae-4888-8f2d-c3d08828d494 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] Returning 404 to user: Instance a5423742-f6e7-40c5-98d6-50f28c3c18ae could not be found. {{(pid=124267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:43:52.687798 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-ba091201-2dae-4888-8f2d-c3d08828d494 tempest-VolumesActionsTest-980100776 tempest-VolumesActionsTest-980100776-project] 10.222.0.102 "GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae" status: 404 len: 111 microversion: 2.1 time: 0.046292 May 26 16:43:52.687972 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-b93982ac-1dc2-42b9-a922-ceedd80d3e33 req-da330adf-a7d2-4aca-8d2f-65bd29ade8f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2f08adf-3dbf-4829-9761-dca0ea87c997", "name": "network-vif-plugged", "status": "completed", "tag": "a4a5aad8-cdec-4c14-a2b1-becfdaa53637"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:43:52.688488 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 197/394] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:52 2022] GET /compute/v2.1/servers/a5423742-f6e7-40c5-98d6-50f28c3c18ae => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 16:43:52.708522 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-b93982ac-1dc2-42b9-a922-ceedd80d3e33 req-da330adf-a7d2-4aca-8d2f-65bd29ade8f2 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:52.709636 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-b93982ac-1dc2-42b9-a922-ceedd80d3e33 req-da330adf-a7d2-4aca-8d2f-65bd29ade8f2 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:52.734884 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-b93982ac-1dc2-42b9-a922-ceedd80d3e33 req-da330adf-a7d2-4aca-8d2f-65bd29ade8f2 service nova] Creating event network-vif-plugged:a4a5aad8-cdec-4c14-a2b1-becfdaa53637 for instance e2f08adf-3dbf-4829-9761-dca0ea87c997 on hv-cinder-83607 May 26 16:43:52.742547 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-b93982ac-1dc2-42b9-a922-ceedd80d3e33 req-da330adf-a7d2-4aca-8d2f-65bd29ade8f2 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060394 May 26 16:43:52.744189 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 198/395] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:43:52.810888 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-2828f3b3-168b-44f4-b786-e564798ea303 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:52.811991 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-2828f3b3-168b-44f4-b786-e564798ea303 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:52.835012 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2828f3b3-168b-44f4-b786-e564798ea303 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:52.835012 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2828f3b3-168b-44f4-b786-e564798ea303 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:52.836350 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2828f3b3-168b-44f4-b786-e564798ea303 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:52.836839 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2828f3b3-168b-44f4-b786-e564798ea303 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:53.038650 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2eeb4115-075a-43fc-8b51-0d672eb5a455 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:53.038650 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2eeb4115-075a-43fc-8b51-0d672eb5a455 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] [instance: e2f08adf-3dbf-4829-9761-dca0ea87c997] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:53.045567 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2eeb4115-075a-43fc-8b51-0d672eb5a455 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:53.046093 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2eeb4115-075a-43fc-8b51-0d672eb5a455 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:53.046981 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2eeb4115-075a-43fc-8b51-0d672eb5a455 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:53.047503 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2eeb4115-075a-43fc-8b51-0d672eb5a455 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:53.149194 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-2828f3b3-168b-44f4-b786-e564798ea303 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:53.158715 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-2828f3b3-168b-44f4-b786-e564798ea303 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1524 microversion: 2.1 time: 0.357213 May 26 16:43:53.159509 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 198/396] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:52 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1524 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:53.344182 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-2eeb4115-075a-43fc-8b51-0d672eb5a455 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67b0bec1d74cf1a07415665e782d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4d322cc014464da21503514cd08b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:53.356245 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2eeb4115-075a-43fc-8b51-0d672eb5a455 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] 10.222.0.102 "GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997" status: 200 len: 1318 microversion: 2.1 time: 0.325717 May 26 16:43:53.357286 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 199/397] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:53 2022] GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997 => generated 1318 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:54.177556 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-ed8e59a4-e09d-43c9-98f9-6ef528a4ca5f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:54.178179 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-ed8e59a4-e09d-43c9-98f9-6ef528a4ca5f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:54.185360 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ed8e59a4-e09d-43c9-98f9-6ef528a4ca5f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:54.185823 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ed8e59a4-e09d-43c9-98f9-6ef528a4ca5f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:54.186623 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ed8e59a4-e09d-43c9-98f9-6ef528a4ca5f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:54.187063 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ed8e59a4-e09d-43c9-98f9-6ef528a4ca5f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:54.361553 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-ed8e59a4-e09d-43c9-98f9-6ef528a4ca5f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:54.373749 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d5b0480f-45a4-447d-8426-ae53a1a6f72d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:54.374357 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d5b0480f-45a4-447d-8426-ae53a1a6f72d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] [instance: e2f08adf-3dbf-4829-9761-dca0ea87c997] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:54.380644 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-ed8e59a4-e09d-43c9-98f9-6ef528a4ca5f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1524 microversion: 2.1 time: 0.207293 May 26 16:43:54.381231 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 199/398] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:54 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1524 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:54.385396 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d5b0480f-45a4-447d-8426-ae53a1a6f72d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:54.386087 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d5b0480f-45a4-447d-8426-ae53a1a6f72d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:54.387016 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d5b0480f-45a4-447d-8426-ae53a1a6f72d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:54.387610 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d5b0480f-45a4-447d-8426-ae53a1a6f72d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:54.536611 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d5b0480f-45a4-447d-8426-ae53a1a6f72d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67b0bec1d74cf1a07415665e782d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4d322cc014464da21503514cd08b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:54.544608 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d5b0480f-45a4-447d-8426-ae53a1a6f72d tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] 10.222.0.102 "GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997" status: 200 len: 1318 microversion: 2.1 time: 0.174803 May 26 16:43:54.545584 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 200/399] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:54 2022] GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:55.399801 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-3d46e102-5179-4636-89aa-eab64eefa6d3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:55.400659 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-3d46e102-5179-4636-89aa-eab64eefa6d3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:55.406575 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3d46e102-5179-4636-89aa-eab64eefa6d3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:55.407029 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3d46e102-5179-4636-89aa-eab64eefa6d3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:55.407795 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3d46e102-5179-4636-89aa-eab64eefa6d3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:55.408227 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3d46e102-5179-4636-89aa-eab64eefa6d3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:55.550952 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-3d46e102-5179-4636-89aa-eab64eefa6d3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:55.558646 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-3d46e102-5179-4636-89aa-eab64eefa6d3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1524 microversion: 2.1 time: 0.163668 May 26 16:43:55.559219 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 200/400] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:55 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1524 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:55.563694 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f5fcd4f5-c6d6-4de4-b5d0-1053b1b7350c tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:55.564220 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f5fcd4f5-c6d6-4de4-b5d0-1053b1b7350c tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] [instance: e2f08adf-3dbf-4829-9761-dca0ea87c997] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:55.570886 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f5fcd4f5-c6d6-4de4-b5d0-1053b1b7350c tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:55.571442 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f5fcd4f5-c6d6-4de4-b5d0-1053b1b7350c tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:55.572224 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f5fcd4f5-c6d6-4de4-b5d0-1053b1b7350c tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:55.572720 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f5fcd4f5-c6d6-4de4-b5d0-1053b1b7350c tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:55.739479 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f5fcd4f5-c6d6-4de4-b5d0-1053b1b7350c tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67b0bec1d74cf1a07415665e782d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4d322cc014464da21503514cd08b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:55.747621 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f5fcd4f5-c6d6-4de4-b5d0-1053b1b7350c tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] 10.222.0.102 "GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997" status: 200 len: 1318 microversion: 2.1 time: 0.189633 May 26 16:43:55.748214 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 201/401] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:55 2022] GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:56.575974 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-ad802163-6691-4d40-94da-2192e48ae283 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:56.576627 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-ad802163-6691-4d40-94da-2192e48ae283 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:56.582975 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ad802163-6691-4d40-94da-2192e48ae283 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:56.583417 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ad802163-6691-4d40-94da-2192e48ae283 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:56.584478 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ad802163-6691-4d40-94da-2192e48ae283 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:56.584913 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ad802163-6691-4d40-94da-2192e48ae283 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:56.725081 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-ad802163-6691-4d40-94da-2192e48ae283 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:56.733417 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-ad802163-6691-4d40-94da-2192e48ae283 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1524 microversion: 2.1 time: 0.161054 May 26 16:43:56.734002 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 201/402] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:56 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1524 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:56.764504 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0a896e43-19f5-4570-8474-4abfa0e18d02 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:56.765114 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0a896e43-19f5-4570-8474-4abfa0e18d02 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] [instance: e2f08adf-3dbf-4829-9761-dca0ea87c997] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:56.772097 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0a896e43-19f5-4570-8474-4abfa0e18d02 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:56.772569 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0a896e43-19f5-4570-8474-4abfa0e18d02 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:56.773375 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0a896e43-19f5-4570-8474-4abfa0e18d02 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:56.774331 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0a896e43-19f5-4570-8474-4abfa0e18d02 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:56.914173 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0a896e43-19f5-4570-8474-4abfa0e18d02 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67b0bec1d74cf1a07415665e782d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4d322cc014464da21503514cd08b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:56.921807 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0a896e43-19f5-4570-8474-4abfa0e18d02 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] 10.222.0.102 "GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997" status: 200 len: 1318 microversion: 2.1 time: 0.161164 May 26 16:43:56.922396 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 202/403] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:56 2022] GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:57.750575 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-113a551e-eee1-42c4-a6a5-05bb1423e3a9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:57.751222 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-113a551e-eee1-42c4-a6a5-05bb1423e3a9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:57.757662 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-113a551e-eee1-42c4-a6a5-05bb1423e3a9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:57.758116 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-113a551e-eee1-42c4-a6a5-05bb1423e3a9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:57.758899 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-113a551e-eee1-42c4-a6a5-05bb1423e3a9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:57.759342 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-113a551e-eee1-42c4-a6a5-05bb1423e3a9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:57.900684 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-113a551e-eee1-42c4-a6a5-05bb1423e3a9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:57.909105 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-113a551e-eee1-42c4-a6a5-05bb1423e3a9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1524 microversion: 2.1 time: 0.162308 May 26 16:43:57.909708 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 202/404] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:57 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1524 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:57.941757 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9c6511f1-1335-42ea-8945-9cdbadec0fd1 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:57.942555 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9c6511f1-1335-42ea-8945-9cdbadec0fd1 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] [instance: e2f08adf-3dbf-4829-9761-dca0ea87c997] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:57.949624 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9c6511f1-1335-42ea-8945-9cdbadec0fd1 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:57.950152 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9c6511f1-1335-42ea-8945-9cdbadec0fd1 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:57.950965 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9c6511f1-1335-42ea-8945-9cdbadec0fd1 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:57.951542 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9c6511f1-1335-42ea-8945-9cdbadec0fd1 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:58.100886 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9c6511f1-1335-42ea-8945-9cdbadec0fd1 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67b0bec1d74cf1a07415665e782d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4d322cc014464da21503514cd08b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:58.109912 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9c6511f1-1335-42ea-8945-9cdbadec0fd1 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] 10.222.0.102 "GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997" status: 200 len: 1318 microversion: 2.1 time: 0.172534 May 26 16:43:58.110510 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 203/405] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:57 2022] GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:58.927189 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-b5f2b4c4-cbf7-47b7-a6c8-ad9b9f7b6405 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:58.927788 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-b5f2b4c4-cbf7-47b7-a6c8-ad9b9f7b6405 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:58.934835 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b5f2b4c4-cbf7-47b7-a6c8-ad9b9f7b6405 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:58.935283 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b5f2b4c4-cbf7-47b7-a6c8-ad9b9f7b6405 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:58.936061 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b5f2b4c4-cbf7-47b7-a6c8-ad9b9f7b6405 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:58.936535 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b5f2b4c4-cbf7-47b7-a6c8-ad9b9f7b6405 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:59.091789 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-b5f2b4c4-cbf7-47b7-a6c8-ad9b9f7b6405 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:59.104914 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-b5f2b4c4-cbf7-47b7-a6c8-ad9b9f7b6405 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1524 microversion: 2.1 time: 0.181505 May 26 16:43:59.105518 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 203/406] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:58 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1524 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:59.129680 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-4e2b0af6-2df2-4707-bfc4-204e82205d12 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:59.130327 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-4e2b0af6-2df2-4707-bfc4-204e82205d12 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] [instance: e2f08adf-3dbf-4829-9761-dca0ea87c997] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:59.137612 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4e2b0af6-2df2-4707-bfc4-204e82205d12 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:59.138071 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4e2b0af6-2df2-4707-bfc4-204e82205d12 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:59.138848 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4e2b0af6-2df2-4707-bfc4-204e82205d12 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:59.139280 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4e2b0af6-2df2-4707-bfc4-204e82205d12 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:59.286969 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-4e2b0af6-2df2-4707-bfc4-204e82205d12 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67b0bec1d74cf1a07415665e782d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4d322cc014464da21503514cd08b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:59.295330 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-4e2b0af6-2df2-4707-bfc4-204e82205d12 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] 10.222.0.102 "GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997" status: 200 len: 1468 microversion: 2.1 time: 0.170098 May 26 16:43:59.295821 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 204/407] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:59 2022] GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997 => generated 1468 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:43:59.343377 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-b8a5b96b-bbd7-4306-8888-fbb16ee3979c tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:59.343884 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-b8a5b96b-bbd7-4306-8888-fbb16ee3979c tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] [instance: e2f08adf-3dbf-4829-9761-dca0ea87c997] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:59.350234 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b8a5b96b-bbd7-4306-8888-fbb16ee3979c tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:59.350688 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b8a5b96b-bbd7-4306-8888-fbb16ee3979c tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:59.352060 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b8a5b96b-bbd7-4306-8888-fbb16ee3979c tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:59.352530 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b8a5b96b-bbd7-4306-8888-fbb16ee3979c tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:59.381142 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-b8a5b96b-bbd7-4306-8888-fbb16ee3979c tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] [instance: e2f08adf-3dbf-4829-9761-dca0ea87c997] Going to try to terminate instance {{(pid=124267) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 16:43:59.483122 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-b8a5b96b-bbd7-4306-8888-fbb16ee3979c tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] 10.222.0.102 "DELETE /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997" status: 204 len: 0 microversion: 2.1 time: 0.143366 May 26 16:43:59.484137 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 204/408] 10.222.0.102 () {58 vars in 1243 bytes} [Thu May 26 16:43:59 2022] DELETE /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 16:43:59.496294 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7fffa549-d0c1-45a0-abdd-ff5f496bdac7 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:59.503276 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-7fffa549-d0c1-45a0-abdd-ff5f496bdac7 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] [instance: e2f08adf-3dbf-4829-9761-dca0ea87c997] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:43:59.520194 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7fffa549-d0c1-45a0-abdd-ff5f496bdac7 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:59.520713 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7fffa549-d0c1-45a0-abdd-ff5f496bdac7 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:59.521537 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7fffa549-d0c1-45a0-abdd-ff5f496bdac7 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:59.521978 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7fffa549-d0c1-45a0-abdd-ff5f496bdac7 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:59.724326 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7fffa549-d0c1-45a0-abdd-ff5f496bdac7 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67b0bec1d74cf1a07415665e782d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4d322cc014464da21503514cd08b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:43:59.733774 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7fffa549-d0c1-45a0-abdd-ff5f496bdac7 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] 10.222.0.102 "GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997" status: 200 len: 1474 microversion: 2.1 time: 0.243097 May 26 16:43:59.740984 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 205/409] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:43:59 2022] GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997 => generated 1474 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:44:00.124094 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-e3db9d49-0791-4e0c-bac9-b2632fe217fd tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:44:00.125636 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-e3db9d49-0791-4e0c-bac9-b2632fe217fd tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:44:00.132344 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e3db9d49-0791-4e0c-bac9-b2632fe217fd tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:00.133374 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e3db9d49-0791-4e0c-bac9-b2632fe217fd tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:00.134171 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e3db9d49-0791-4e0c-bac9-b2632fe217fd tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:00.134610 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e3db9d49-0791-4e0c-bac9-b2632fe217fd tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:00.364817 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-e3db9d49-0791-4e0c-bac9-b2632fe217fd tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:44:00.379491 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-e3db9d49-0791-4e0c-bac9-b2632fe217fd tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1524 microversion: 2.1 time: 0.259256 May 26 16:44:00.381218 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 205/410] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:44:00 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1524 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:44:00.757952 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-954b4a8a-fc31-47e1-aa7b-827dd94bb355 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:44:00.759419 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-954b4a8a-fc31-47e1-aa7b-827dd94bb355 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] [instance: e2f08adf-3dbf-4829-9761-dca0ea87c997] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:44:00.769180 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-954b4a8a-fc31-47e1-aa7b-827dd94bb355 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:00.770218 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-954b4a8a-fc31-47e1-aa7b-827dd94bb355 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:00.771287 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-954b4a8a-fc31-47e1-aa7b-827dd94bb355 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:00.771728 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-954b4a8a-fc31-47e1-aa7b-827dd94bb355 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:00.995485 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-954b4a8a-fc31-47e1-aa7b-827dd94bb355 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67b0bec1d74cf1a07415665e782d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4d322cc014464da21503514cd08b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:44:01.010225 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-954b4a8a-fc31-47e1-aa7b-827dd94bb355 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] 10.222.0.102 "GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997" status: 200 len: 1474 microversion: 2.1 time: 0.260081 May 26 16:44:01.025364 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 206/411] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:44:00 2022] GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997 => generated 1474 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:44:01.397700 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-1ee1323f-9563-4e73-a0e0-b1bf2ed2191b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:44:01.402908 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-1ee1323f-9563-4e73-a0e0-b1bf2ed2191b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:44:01.420197 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1ee1323f-9563-4e73-a0e0-b1bf2ed2191b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:01.420681 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1ee1323f-9563-4e73-a0e0-b1bf2ed2191b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:01.421471 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1ee1323f-9563-4e73-a0e0-b1bf2ed2191b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:01.421905 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1ee1323f-9563-4e73-a0e0-b1bf2ed2191b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:01.668086 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-1ee1323f-9563-4e73-a0e0-b1bf2ed2191b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:44:01.679782 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-1ee1323f-9563-4e73-a0e0-b1bf2ed2191b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1524 microversion: 2.1 time: 0.286067 May 26 16:44:01.680536 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 206/412] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:44:01 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1524 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:44:02.040009 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6287be30-6a1a-49aa-a688-904acf3643c8 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:44:02.041048 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-6287be30-6a1a-49aa-a688-904acf3643c8 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] [instance: e2f08adf-3dbf-4829-9761-dca0ea87c997] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:44:02.054470 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6287be30-6a1a-49aa-a688-904acf3643c8 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:02.056179 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6287be30-6a1a-49aa-a688-904acf3643c8 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:02.060004 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6287be30-6a1a-49aa-a688-904acf3643c8 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:02.060836 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6287be30-6a1a-49aa-a688-904acf3643c8 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:02.330669 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6287be30-6a1a-49aa-a688-904acf3643c8 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67b0bec1d74cf1a07415665e782d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4d322cc014464da21503514cd08b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:44:02.345611 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6287be30-6a1a-49aa-a688-904acf3643c8 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] 10.222.0.102 "GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997" status: 200 len: 1474 microversion: 2.1 time: 0.315554 May 26 16:44:02.355982 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 207/413] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:44:02 2022] GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997 => generated 1474 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:44:02.727180 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-3ddb3598-c306-42a1-b4d8-4e7d54609280 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:44:02.728323 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-3ddb3598-c306-42a1-b4d8-4e7d54609280 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:44:02.752175 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3ddb3598-c306-42a1-b4d8-4e7d54609280 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:02.754128 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3ddb3598-c306-42a1-b4d8-4e7d54609280 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:02.756268 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3ddb3598-c306-42a1-b4d8-4e7d54609280 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:02.758086 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3ddb3598-c306-42a1-b4d8-4e7d54609280 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:03.200437 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-3ddb3598-c306-42a1-b4d8-4e7d54609280 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:44:03.231710 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-3ddb3598-c306-42a1-b4d8-4e7d54609280 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1524 microversion: 2.1 time: 0.533473 May 26 16:44:03.240884 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 207/414] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:44:02 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1524 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:44:03.369230 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e4f44100-f49d-4dca-a781-970a9f6b160b tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:44:03.371984 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e4f44100-f49d-4dca-a781-970a9f6b160b tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] [instance: e2f08adf-3dbf-4829-9761-dca0ea87c997] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:44:03.395928 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e4f44100-f49d-4dca-a781-970a9f6b160b tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:03.403068 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e4f44100-f49d-4dca-a781-970a9f6b160b tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:03.407244 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e4f44100-f49d-4dca-a781-970a9f6b160b tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:03.408761 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e4f44100-f49d-4dca-a781-970a9f6b160b tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:04.019855 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e4f44100-f49d-4dca-a781-970a9f6b160b tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67b0bec1d74cf1a07415665e782d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4d322cc014464da21503514cd08b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:44:04.041837 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e4f44100-f49d-4dca-a781-970a9f6b160b tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] 10.222.0.102 "GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997" status: 200 len: 1474 microversion: 2.1 time: 0.681226 May 26 16:44:04.043826 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 208/415] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:44:03 2022] GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997 => generated 1474 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:44:04.262657 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-16ca2fa3-fd98-477b-8de4-b2e6c3336261 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:44:04.263443 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-16ca2fa3-fd98-477b-8de4-b2e6c3336261 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:44:04.265871 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:04.317802 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-16ca2fa3-fd98-477b-8de4-b2e6c3336261 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:04.319704 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-16ca2fa3-fd98-477b-8de4-b2e6c3336261 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:04.326453 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-78b3189c-6248-4091-b6fb-2f5f70ffaa48 req-947932fe-3579-4658-9418-5c576470d885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2f08adf-3dbf-4829-9761-dca0ea87c997", "name": "network-vif-deleted", "tag": "a4a5aad8-cdec-4c14-a2b1-becfdaa53637"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:44:04.336750 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-16ca2fa3-fd98-477b-8de4-b2e6c3336261 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:04.337680 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-16ca2fa3-fd98-477b-8de4-b2e6c3336261 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:04.345442 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=72 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:04.348099 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-78b3189c-6248-4091-b6fb-2f5f70ffaa48 req-947932fe-3579-4658-9418-5c576470d885 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:04.351193 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-78b3189c-6248-4091-b6fb-2f5f70ffaa48 req-947932fe-3579-4658-9418-5c576470d885 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:04.384063 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-78b3189c-6248-4091-b6fb-2f5f70ffaa48 req-947932fe-3579-4658-9418-5c576470d885 service nova] Creating event network-vif-deleted:a4a5aad8-cdec-4c14-a2b1-becfdaa53637 for instance e2f08adf-3dbf-4829-9761-dca0ea87c997 on hv-cinder-83607 May 26 16:44:04.400570 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-78b3189c-6248-4091-b6fb-2f5f70ffaa48 req-947932fe-3579-4658-9418-5c576470d885 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090354 May 26 16:44:04.407435 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 209/416] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:44:04.676998 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-16ca2fa3-fd98-477b-8de4-b2e6c3336261 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:44:04.689579 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-16ca2fa3-fd98-477b-8de4-b2e6c3336261 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1524 microversion: 2.1 time: 0.431200 May 26 16:44:04.690180 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 208/417] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:44:04 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1524 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:44:05.077433 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-c9e787cc-5e21-4f43-9248-fdff9e4dd02e tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:44:05.080944 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-c9e787cc-5e21-4f43-9248-fdff9e4dd02e tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] [instance: e2f08adf-3dbf-4829-9761-dca0ea87c997] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:44:05.125333 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c9e787cc-5e21-4f43-9248-fdff9e4dd02e tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:05.126177 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c9e787cc-5e21-4f43-9248-fdff9e4dd02e tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:05.128166 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c9e787cc-5e21-4f43-9248-fdff9e4dd02e tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:05.129082 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c9e787cc-5e21-4f43-9248-fdff9e4dd02e tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:05.263729 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c9e787cc-5e21-4f43-9248-fdff9e4dd02e tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:05.265326 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c9e787cc-5e21-4f43-9248-fdff9e4dd02e tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:05.266032 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.objects.instance [None req-c9e787cc-5e21-4f43-9248-fdff9e4dd02e tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lazy-loading 'fault' on Instance uuid e2f08adf-3dbf-4829-9761-dca0ea87c997 {{(pid=124266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:44:05.589832 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c9e787cc-5e21-4f43-9248-fdff9e4dd02e tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67b0bec1d74cf1a07415665e782d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4d322cc014464da21503514cd08b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:44:05.614748 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-c9e787cc-5e21-4f43-9248-fdff9e4dd02e tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] 10.222.0.102 "GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997" status: 200 len: 1308 microversion: 2.1 time: 0.547041 May 26 16:44:05.616680 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 210/418] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:44:05 2022] GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997 => generated 1308 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:44:05.710801 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-bddb5d06-0ebd-43aa-8dc7-0cb061bc2d36 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:44:05.712173 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-bddb5d06-0ebd-43aa-8dc7-0cb061bc2d36 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:44:05.719661 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bddb5d06-0ebd-43aa-8dc7-0cb061bc2d36 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:05.720520 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bddb5d06-0ebd-43aa-8dc7-0cb061bc2d36 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:05.721546 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bddb5d06-0ebd-43aa-8dc7-0cb061bc2d36 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:05.722245 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bddb5d06-0ebd-43aa-8dc7-0cb061bc2d36 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:05.916910 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-bddb5d06-0ebd-43aa-8dc7-0cb061bc2d36 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:44:05.934454 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-bddb5d06-0ebd-43aa-8dc7-0cb061bc2d36 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1504 microversion: 2.1 time: 0.229413 May 26 16:44:05.935284 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 209/419] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:44:05 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1504 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:44:05.963006 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-08fe200e-c862-43ec-a13d-21bb51879872 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72910d6c-cc5a-4e5b-96a0-a1489406a482"}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:44:05.964433 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-08fe200e-c862-43ec-a13d-21bb51879872 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:44:05.975086 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-08fe200e-c862-43ec-a13d-21bb51879872 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:05.976437 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-08fe200e-c862-43ec-a13d-21bb51879872 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:05.978474 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-08fe200e-c862-43ec-a13d-21bb51879872 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:05.980337 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-08fe200e-c862-43ec-a13d-21bb51879872 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:06.028004 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-08fe200e-c862-43ec-a13d-21bb51879872 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] HTTP exception thrown: Cannot 'attach_volume' instance 6a691d98-aaca-4c24-9200-19517540e68e while it is in vm_state rescued May 26 16:44:06.032472 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-08fe200e-c862-43ec-a13d-21bb51879872 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Request method failure captured: May 26 16:44:06.032472 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: request: POST /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e/os-volume_attachments HTTP/1.1 May 26 16:44:06.032472 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept: application/json May 26 16:44:06.032472 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity May 26 16:44:06.032472 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Connection: close May 26 16:44:06.032472 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Length: 74 May 26 16:44:06.032472 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Type: application/json May 26 16:44:06.032472 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Host: 10.222.0.102 May 26 16:44:06.032472 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None May 26 16:44:06.032472 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 May 26 16:44:06.032472 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABij62o9giAUjK9QPbUFbwFo-FgFlOy7dIdimEDaohYi-sKTCdB1x5HtixELEAzUkpBuerDG9JUdHvExIjWA4U-cGIqZbLgDVo_-1KrAr5aGX22qLivGdFGb8QTOdP7EHcYJDUTZmj-LaOBh6ZTeQxUKquK1A4-AFQYG9aL6_6JaqjZXrQ May 26 16:44:06.032472 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Id: None May 26 16:44:06.032472 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Name: None May 26 16:44:06.032472 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed May 26 16:44:06.032472 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True May 26 16:44:06.032472 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default May 26 16:44:06.032472 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default May 26 16:44:06.032472 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Id: a85ded3a20964dbbbc354199f5129d9b May 26 16:44:06.032472 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1592668870 May 26 16:44:06.032472 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Role: reader,member May 26 16:44:06.032472 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Roles: reader,member May 26 16:44:06.036114 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/a85ded3a20964dbbbc354199f5129d9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/a85ded3a20964dbbbc354199f5129d9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/a85ded3a20964dbbbc354199f5129d9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_a85ded3a20964dbbbc354199f5129d9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:44:06.036114 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1592668870 May 26 16:44:06.036114 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Id: a85ded3a20964dbbbc354199f5129d9b May 26 16:44:06.036114 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1592668870 May 26 16:44:06.036114 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User: tempest-ServerRescueNegativeTestJSON-1592668870-project May 26 16:44:06.036114 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default May 26 16:44:06.036114 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default May 26 16:44:06.036114 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Id: 9330e65e73394f18b87c5b1d5d47f564 May 26 16:44:06.036114 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1592668870-project May 26 16:44:06.036114 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: May 26 16:44:06.036114 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: {"volumeAttachment": {"volumeId": "72910d6c-cc5a-4e5b-96a0-a1489406a482"}} May 26 16:44:06.036114 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: method: > May 26 16:44:06.037601 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: exception: Cannot 'attach_volume' instance 6a691d98-aaca-4c24-9200-19517540e68e while it is in vm_state rescued May 26 16:44:06.037601 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: action_args: {'server_id': '6a691d98-aaca-4c24-9200-19517540e68e', 'body': {'volumeAttachment': {'volumeId': '72910d6c-cc5a-4e5b-96a0-a1489406a482'}}} May 26 16:44:06.037601 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:44:06.037601 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:44:06.037601 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 16:44:06.037601 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 16:44:06.037601 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 16:44:06.037601 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 16:44:06.037601 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 26 16:44:06.037601 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 26 16:44:06.037601 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6a691d98-aaca-4c24-9200-19517540e68e in vm_state rescued. Cannot attach_volume while the instance is in this state. May 26 16:44:06.037601 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:44:06.037601 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:44:06.037601 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:44:06.037601 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:44:06.037601 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:44:06.037601 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:44:06.037601 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:44:06.037601 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:44:06.039913 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:44:06.039913 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:44:06.039913 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 16:44:06.039913 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 16:44:06.039913 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 16:44:06.039913 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 16:44:06.039913 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 16:44:06.039913 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 16:44:06.039913 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 26 16:44:06.039913 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 26 16:44:06.039913 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 26 16:44:06.039913 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 26 16:44:06.039913 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 6a691d98-aaca-4c24-9200-19517540e68e while it is in vm_state rescued May 26 16:44:06.039913 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:44:06.039913 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:44:06.039913 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:44:06.039913 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:44:06.039913 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:44:06.039913 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:44:06.043049 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:44:06.043049 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:44:06.043049 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 6a691d98-aaca-4c24-9200-19517540e68e while it is in vm_state rescued May 26 16:44:06.043049 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:44:06.043049 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-08fe200e-c862-43ec-a13d-21bb51879872 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Returning 409 to user: Cannot 'attach_volume' instance 6a691d98-aaca-4c24-9200-19517540e68e while it is in vm_state rescued {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:44:06.052714 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-08fe200e-c862-43ec-a13d-21bb51879872 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "POST /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.087017 May 26 16:44:06.052714 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 211/420] 10.222.0.102 () {60 vars in 1327 bytes} [Thu May 26 16:44:05 2022] POST /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e/os-volume_attachments => generated 152 bytes in 90 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 26 16:44:06.058069 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-ffc587a7-8812-4786-8ec2-16bcf34a5ba9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:44:06.059373 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-ffc587a7-8812-4786-8ec2-16bcf34a5ba9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:44:06.067034 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ffc587a7-8812-4786-8ec2-16bcf34a5ba9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:06.067724 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ffc587a7-8812-4786-8ec2-16bcf34a5ba9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:06.068821 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ffc587a7-8812-4786-8ec2-16bcf34a5ba9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:06.069631 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ffc587a7-8812-4786-8ec2-16bcf34a5ba9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:06.258070 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:06.290595 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-ffc587a7-8812-4786-8ec2-16bcf34a5ba9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "POST /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e/action" status: 202 len: 0 microversion: 2.1 time: 0.234056 May 26 16:44:06.299479 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 210/421] 10.222.0.102 () {60 vars in 1282 bytes} [Thu May 26 16:44:06 2022] POST /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 16:44:06.303003 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6fc52b7b-7928-4c5b-9dd2-6213dd793625 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:44:06.305101 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-6fc52b7b-7928-4c5b-9dd2-6213dd793625 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:44:06.322443 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6fc52b7b-7928-4c5b-9dd2-6213dd793625 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:06.324118 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6fc52b7b-7928-4c5b-9dd2-6213dd793625 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:06.325541 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6fc52b7b-7928-4c5b-9dd2-6213dd793625 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:06.326326 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6fc52b7b-7928-4c5b-9dd2-6213dd793625 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:06.593338 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6fc52b7b-7928-4c5b-9dd2-6213dd793625 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:44:06.610881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6fc52b7b-7928-4c5b-9dd2-6213dd793625 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1512 microversion: 2.1 time: 0.311230 May 26 16:44:06.612853 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 212/422] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:44:06 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1512 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:44:06.644093 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-1e5fb331-5907-413f-b489-796f48b73a78 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:44:06.645479 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-1e5fb331-5907-413f-b489-796f48b73a78 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] [instance: e2f08adf-3dbf-4829-9761-dca0ea87c997] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:44:06.657661 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1e5fb331-5907-413f-b489-796f48b73a78 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:06.658418 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1e5fb331-5907-413f-b489-796f48b73a78 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:06.659872 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1e5fb331-5907-413f-b489-796f48b73a78 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:06.660653 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1e5fb331-5907-413f-b489-796f48b73a78 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:06.714353 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1e5fb331-5907-413f-b489-796f48b73a78 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:06.715392 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1e5fb331-5907-413f-b489-796f48b73a78 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:06.715392 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.objects.instance [None req-1e5fb331-5907-413f-b489-796f48b73a78 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lazy-loading 'fault' on Instance uuid e2f08adf-3dbf-4829-9761-dca0ea87c997 {{(pid=124267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:44:06.787211 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-1e5fb331-5907-413f-b489-796f48b73a78 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67b0bec1d74cf1a07415665e782d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4d322cc014464da21503514cd08b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:44:06.846431 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-1e5fb331-5907-413f-b489-796f48b73a78 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] 10.222.0.102 "GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997" status: 200 len: 1308 microversion: 2.1 time: 0.213042 May 26 16:44:06.850087 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 211/423] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:44:06 2022] GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997 => generated 1308 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:44:07.644835 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ad952c70-f3c2-4b31-a062-82ccf55e3a98 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:44:07.645733 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ad952c70-f3c2-4b31-a062-82ccf55e3a98 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:44:07.655725 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ad952c70-f3c2-4b31-a062-82ccf55e3a98 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:07.656346 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ad952c70-f3c2-4b31-a062-82ccf55e3a98 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:07.657175 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ad952c70-f3c2-4b31-a062-82ccf55e3a98 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:07.657805 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ad952c70-f3c2-4b31-a062-82ccf55e3a98 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:07.887156 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-16fd1929-8d67-4412-998c-065de73f5fc8 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:44:07.888643 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-16fd1929-8d67-4412-998c-065de73f5fc8 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] [instance: e2f08adf-3dbf-4829-9761-dca0ea87c997] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:44:07.903004 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-16fd1929-8d67-4412-998c-065de73f5fc8 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:07.903677 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-16fd1929-8d67-4412-998c-065de73f5fc8 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:07.905812 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-16fd1929-8d67-4412-998c-065de73f5fc8 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:07.906587 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-16fd1929-8d67-4412-998c-065de73f5fc8 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:07.921458 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ad952c70-f3c2-4b31-a062-82ccf55e3a98 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:44:07.935149 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ad952c70-f3c2-4b31-a062-82ccf55e3a98 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1512 microversion: 2.1 time: 0.297135 May 26 16:44:07.935734 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 213/424] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:44:07 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1512 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:44:07.940623 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.wsgi [None req-16fd1929-8d67-4412-998c-065de73f5fc8 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] HTTP exception thrown: Instance e2f08adf-3dbf-4829-9761-dca0ea87c997 could not be found. May 26 16:44:07.942409 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-16fd1929-8d67-4412-998c-065de73f5fc8 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Request method failure captured: May 26 16:44:07.942409 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: request: GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997 HTTP/1.1 May 26 16:44:07.942409 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept: application/json May 26 16:44:07.942409 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept-Encoding: identity May 26 16:44:07.942409 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Connection: close May 26 16:44:07.942409 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Length: 0 May 26 16:44:07.942409 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Type: application/json May 26 16:44:07.942409 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Host: 10.222.0.102 May 26 16:44:07.942409 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Openstack-System-Scope: None May 26 16:44:07.942409 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: User-Agent: python-urllib3/1.26.9 May 26 16:44:07.942409 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Auth-Token: gAAAAABij64lV9E-CfMnKWZxpOLAcxw-TPpeFN80Idjw7h7Rz-Ulh8J3BLnCzktF_ae013aVrwI19Qy9eeN3WvbjmawV_LnY02RVwm4zcn7lqL90Ig823yAu5lVv6e2Y-zmgN0N0yAsf9wZQGkJl9MZ_XTNjZa_aJ-T5F_xNSF5c3qusy8iAJkk May 26 16:44:07.942409 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Id: None May 26 16:44:07.942409 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Name: None May 26 16:44:07.942409 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Identity-Status: Confirmed May 26 16:44:07.942409 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Is-Admin-Project: True May 26 16:44:07.942409 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Id: default May 26 16:44:07.942409 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Name: Default May 26 16:44:07.942409 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Id: 2b4d322cc014464da21503514cd08b91 May 26 16:44:07.942409 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Name: tempest-VolumesNegativeTest-1813135295 May 26 16:44:07.942409 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Role: reader,member May 26 16:44:07.942409 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Roles: reader,member May 26 16:44:07.946716 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/2b4d322cc014464da21503514cd08b91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/2b4d322cc014464da21503514cd08b91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/2b4d322cc014464da21503514cd08b91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_2b4d322cc014464da21503514cd08b91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:44:07.946716 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant: tempest-VolumesNegativeTest-1813135295 May 26 16:44:07.946716 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Id: 2b4d322cc014464da21503514cd08b91 May 26 16:44:07.946716 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Name: tempest-VolumesNegativeTest-1813135295 May 26 16:44:07.946716 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User: tempest-VolumesNegativeTest-1813135295-project May 26 16:44:07.946716 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Id: default May 26 16:44:07.946716 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Name: Default May 26 16:44:07.946716 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Id: 6f67b0bec1d74cf1a07415665e782d2e May 26 16:44:07.946716 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Name: tempest-VolumesNegativeTest-1813135295-project May 26 16:44:07.946716 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: method: > May 26 16:44:07.946716 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: exception: Instance e2f08adf-3dbf-4829-9761-dca0ea87c997 could not be found. May 26 16:44:07.946716 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: action_args: {'id': 'e2f08adf-3dbf-4829-9761-dca0ea87c997'} May 26 16:44:07.949489 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:44:07.949489 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:44:07.949489 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:44:07.949489 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:44:07.949489 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:44:07.949489 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:44:07.949489 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:44:07.949489 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:44:07.949489 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:44:07.949489 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:44:07.949489 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2f08adf-3dbf-4829-9761-dca0ea87c997 could not be found. May 26 16:44:07.949489 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:44:07.949489 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:44:07.949489 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:44:07.949489 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:44:07.949489 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:44:07.949489 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:44:07.949489 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:44:07.949489 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:44:07.949489 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:44:07.952191 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:44:07.952191 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 16:44:07.952191 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 16:44:07.952191 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:44:07.952191 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:44:07.952191 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:44:07.952191 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:44:07.952191 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2f08adf-3dbf-4829-9761-dca0ea87c997 could not be found. May 26 16:44:07.952191 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:44:07.952191 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:44:07.952191 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:44:07.952191 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:44:07.952191 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:44:07.952191 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:44:07.952191 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:44:07.952191 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:44:07.952191 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2f08adf-3dbf-4829-9761-dca0ea87c997 could not be found. May 26 16:44:07.952191 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:44:07.954654 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-16fd1929-8d67-4412-998c-065de73f5fc8 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] Returning 404 to user: Instance e2f08adf-3dbf-4829-9761-dca0ea87c997 could not be found. {{(pid=124267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:44:07.954654 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-16fd1929-8d67-4412-998c-065de73f5fc8 tempest-VolumesNegativeTest-1813135295 tempest-VolumesNegativeTest-1813135295-project] 10.222.0.102 "GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997" status: 404 len: 111 microversion: 2.1 time: 0.073797 May 26 16:44:07.954654 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 212/425] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:44:07 2022] GET /compute/v2.1/servers/e2f08adf-3dbf-4829-9761-dca0ea87c997 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 16:44:08.966970 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e6b6cb89-d789-4cf1-8aea-3e53e05b9256 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:44:08.969813 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e6b6cb89-d789-4cf1-8aea-3e53e05b9256 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:44:08.985279 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e6b6cb89-d789-4cf1-8aea-3e53e05b9256 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:08.986086 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e6b6cb89-d789-4cf1-8aea-3e53e05b9256 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:08.987492 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e6b6cb89-d789-4cf1-8aea-3e53e05b9256 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:08.988851 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e6b6cb89-d789-4cf1-8aea-3e53e05b9256 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:09.329501 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e6b6cb89-d789-4cf1-8aea-3e53e05b9256 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:44:09.338547 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e6b6cb89-d789-4cf1-8aea-3e53e05b9256 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1512 microversion: 2.1 time: 0.381703 May 26 16:44:09.340020 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 214/426] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:44:08 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1512 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:44:10.387797 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-ebca38e0-f0b9-4b86-bb28-71ec3d265818 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:44:10.387797 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-ebca38e0-f0b9-4b86-bb28-71ec3d265818 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:44:10.405344 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ebca38e0-f0b9-4b86-bb28-71ec3d265818 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:10.412196 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ebca38e0-f0b9-4b86-bb28-71ec3d265818 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:10.419899 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ebca38e0-f0b9-4b86-bb28-71ec3d265818 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:10.421121 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ebca38e0-f0b9-4b86-bb28-71ec3d265818 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:10.706763 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-ebca38e0-f0b9-4b86-bb28-71ec3d265818 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:44:10.721390 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-ebca38e0-f0b9-4b86-bb28-71ec3d265818 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1512 microversion: 2.1 time: 0.358006 May 26 16:44:10.732674 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 213/427] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:44:10 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1512 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:44:11.750758 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6c0bf0c4-c9c1-4ff7-b9b7-d301835305a9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:44:11.752986 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-6c0bf0c4-c9c1-4ff7-b9b7-d301835305a9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:44:11.771531 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6c0bf0c4-c9c1-4ff7-b9b7-d301835305a9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:11.772946 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6c0bf0c4-c9c1-4ff7-b9b7-d301835305a9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:11.775137 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6c0bf0c4-c9c1-4ff7-b9b7-d301835305a9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:11.776599 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6c0bf0c4-c9c1-4ff7-b9b7-d301835305a9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:11.843887 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=100 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:12.074930 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6c0bf0c4-c9c1-4ff7-b9b7-d301835305a9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:44:12.083417 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6c0bf0c4-c9c1-4ff7-b9b7-d301835305a9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1512 microversion: 2.1 time: 0.345591 May 26 16:44:12.084015 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 215/428] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:44:11 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1512 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:44:13.112066 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-976d87fa-b0fe-490a-8816-50741f01eae0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:44:13.112971 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-976d87fa-b0fe-490a-8816-50741f01eae0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:44:13.128068 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-976d87fa-b0fe-490a-8816-50741f01eae0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:13.130345 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-976d87fa-b0fe-490a-8816-50741f01eae0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:13.135878 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-976d87fa-b0fe-490a-8816-50741f01eae0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:13.137572 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-976d87fa-b0fe-490a-8816-50741f01eae0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:13.378571 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-976d87fa-b0fe-490a-8816-50741f01eae0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:44:13.387480 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-976d87fa-b0fe-490a-8816-50741f01eae0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1518 microversion: 2.1 time: 0.286242 May 26 16:44:13.388072 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 214/429] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:44:13 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1518 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:44:16.122575 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-41a09419-1a7c-4f17-be21-a25cb930bbe4 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Action: 'create', calling method: .version_select at 0x7f93a3dd60d0>, body: {"keypair": {"name": "tempest-keypair-2003504419", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMRdAtjownku6cWL7DBpSYPd5ObNvo7q+pPIi97lmDcsUVvWoDgbmQFQkCWTPIgu+IMB4w6l7uSRjpCnK3n6NDmBozhDFgxmbQvJGjSuk5NsT5k67FNKihWwVOUg7bYRQ=="}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:44:16.154437 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-41a09419-1a7c-4f17-be21-a25cb930bbe4 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Getting quotas for project a85ded3a20964dbbbc354199f5129d9b. Resources: {'key_pairs'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:44:16.162857 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-41a09419-1a7c-4f17-be21-a25cb930bbe4 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Getting quotas for user 9330e65e73394f18b87c5b1d5d47f564 and project a85ded3a20964dbbbc354199f5129d9b. Resources: {'key_pairs'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:44:16.196259 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR oslo.messaging._drivers.impl_rabbit [None req-41a09419-1a7c-4f17-be21-a25cb930bbe4 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [eb73edd3-7478-4567-8669-b02774504c39] AMQP server on 10.222.0.102:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 16:44:17.208729 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO oslo.messaging._drivers.impl_rabbit [None req-41a09419-1a7c-4f17-be21-a25cb930bbe4 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [eb73edd3-7478-4567-8669-b02774504c39] Reconnected to AMQP server on 10.222.0.102:5672 via [amqp] client with port 46738. May 26 16:44:17.244583 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-41a09419-1a7c-4f17-be21-a25cb930bbe4 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.136263 May 26 16:44:17.251164 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 216/430] 10.222.0.102 () {60 vars in 1163 bytes} [Thu May 26 16:44:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:44:21.711067 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-d88952e7-5499-43fb-806c-019112f9c92c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-184064084", "imageRef": "d74c4a51-21fe-41d5-865a-cb93604ac3aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8532e65-4cfe-4ff7-9b7e-e643c5e1e677"}], "security_groups": [{"name": "tempest-securitygroup--836651358"}], "key_name": "tempest-keypair-2003504419", "user_data": "}} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:44:23.383971 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=22 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:23.541003 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.network.neutron [None req-d88952e7-5499-43fb-806c-019112f9c92c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] validate_networks() for [('e8532e65-4cfe-4ff7-9b7e-e643c5e1e677', None, None, None, None, None)] {{(pid=124267) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:44:24.308992 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-d88952e7-5499-43fb-806c-019112f9c92c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Flavor limits 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:44:24.309749 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-d88952e7-5499-43fb-806c-019112f9c92c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Image limits 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:44:24.310512 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-d88952e7-5499-43fb-806c-019112f9c92c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Flavor pref 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:44:24.311087 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-d88952e7-5499-43fb-806c-019112f9c92c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Image pref 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:44:24.311704 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-d88952e7-5499-43fb-806c-019112f9c92c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:44:24.333776 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d88952e7-5499-43fb-806c-019112f9c92c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:24.334988 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d88952e7-5499-43fb-806c-019112f9c92c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:24.336536 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d88952e7-5499-43fb-806c-019112f9c92c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:24.338439 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d88952e7-5499-43fb-806c-019112f9c92c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:24.374942 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.quota [None req-d88952e7-5499-43fb-806c-019112f9c92c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Getting quotas for project a85ded3a20964dbbbc354199f5129d9b. Resources: {'cores', 'instances', 'ram'} {{(pid=124267) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:44:24.380354 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.quota [None req-d88952e7-5499-43fb-806c-019112f9c92c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Getting quotas for user 9330e65e73394f18b87c5b1d5d47f564 and project a85ded3a20964dbbbc354199f5129d9b. Resources: {'cores', 'instances', 'ram'} {{(pid=124267) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:44:24.399543 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-d88952e7-5499-43fb-806c-019112f9c92c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Going to run 1 instances... {{(pid=124267) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:44:24.402985 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-d88952e7-5499-43fb-806c-019112f9c92c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d74c4a51-21fe-41d5-865a-cb93604ac3aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:44:24.486059 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-d88952e7-5499-43fb-806c-019112f9c92c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 410 microversion: 2.1 time: 2.789122 May 26 16:44:24.487438 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 215/431] 10.222.0.102 () {60 vars in 1151 bytes} [Thu May 26 16:44:21 2022] POST /compute/v2.1/servers => generated 410 bytes in 2793 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 16:44:24.508212 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d4482587-eb01-4e5b-91e0-c9b525c19485 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:44:24.509374 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d4482587-eb01-4e5b-91e0-c9b525c19485 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:44:24.514710 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=3 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:24.700910 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d4482587-eb01-4e5b-91e0-c9b525c19485 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:44:24.721286 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d4482587-eb01-4e5b-91e0-c9b525c19485 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1249 microversion: 2.1 time: 0.220646 May 26 16:44:24.723297 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 217/432] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:44:24 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1249 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:44:25.755213 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-c7a7e183-95cc-4d96-a4c2-f21bcd515b0b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:44:25.756560 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-c7a7e183-95cc-4d96-a4c2-f21bcd515b0b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:44:25.765551 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c7a7e183-95cc-4d96-a4c2-f21bcd515b0b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:25.767897 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c7a7e183-95cc-4d96-a4c2-f21bcd515b0b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:25.769176 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c7a7e183-95cc-4d96-a4c2-f21bcd515b0b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:25.770233 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c7a7e183-95cc-4d96-a4c2-f21bcd515b0b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:25.925239 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-c7a7e183-95cc-4d96-a4c2-f21bcd515b0b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:44:25.939326 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-c7a7e183-95cc-4d96-a4c2-f21bcd515b0b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1253 microversion: 2.1 time: 0.189642 May 26 16:44:25.940248 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 216/433] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:44:25 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1253 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:44:26.963964 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-04a8ff3f-2a68-4c9e-9b3a-7371d4b43e89 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:44:26.965253 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-04a8ff3f-2a68-4c9e-9b3a-7371d4b43e89 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:44:27.007002 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-04a8ff3f-2a68-4c9e-9b3a-7371d4b43e89 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:27.025942 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-04a8ff3f-2a68-4c9e-9b3a-7371d4b43e89 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:27.041559 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-04a8ff3f-2a68-4c9e-9b3a-7371d4b43e89 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:27.042804 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-04a8ff3f-2a68-4c9e-9b3a-7371d4b43e89 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:27.198406 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-04a8ff3f-2a68-4c9e-9b3a-7371d4b43e89 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:44:27.219613 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-04a8ff3f-2a68-4c9e-9b3a-7371d4b43e89 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1307 microversion: 2.1 time: 0.264406 May 26 16:44:27.232424 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 218/434] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:44:26 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1307 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:44:28.248656 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-18d6f9a1-0996-481f-8ea3-7f2f1af9fa8e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:44:28.249669 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-18d6f9a1-0996-481f-8ea3-7f2f1af9fa8e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:44:28.264083 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-18d6f9a1-0996-481f-8ea3-7f2f1af9fa8e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:28.264716 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-18d6f9a1-0996-481f-8ea3-7f2f1af9fa8e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:28.268296 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-18d6f9a1-0996-481f-8ea3-7f2f1af9fa8e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:28.269206 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-18d6f9a1-0996-481f-8ea3-7f2f1af9fa8e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:28.677260 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-18d6f9a1-0996-481f-8ea3-7f2f1af9fa8e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:44:28.694571 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-18d6f9a1-0996-481f-8ea3-7f2f1af9fa8e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1374 microversion: 2.1 time: 0.453403 May 26 16:44:28.697630 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 217/435] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:44:28 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1374 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:44:29.760764 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-806b0fdd-5a16-4f5a-a1c6-de0ea0e4d551 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:44:29.769586 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-806b0fdd-5a16-4f5a-a1c6-de0ea0e4d551 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:44:29.793420 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-341815b8-6a73-432d-af94-5f0f402bcdcf req-f7045eba-8687-461d-ac20-5258708ed76c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a780ece-54a3-4348-a484-8cc1fd983934", "tag": "f73f919a-97c7-4339-b316-1192335f4fa0"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:44:29.803872 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-806b0fdd-5a16-4f5a-a1c6-de0ea0e4d551 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:29.805449 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-806b0fdd-5a16-4f5a-a1c6-de0ea0e4d551 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:29.808510 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-806b0fdd-5a16-4f5a-a1c6-de0ea0e4d551 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:29.809903 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-806b0fdd-5a16-4f5a-a1c6-de0ea0e4d551 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:29.842533 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-341815b8-6a73-432d-af94-5f0f402bcdcf req-f7045eba-8687-461d-ac20-5258708ed76c service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:29.843516 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-341815b8-6a73-432d-af94-5f0f402bcdcf req-f7045eba-8687-461d-ac20-5258708ed76c service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:29.902585 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-341815b8-6a73-432d-af94-5f0f402bcdcf req-f7045eba-8687-461d-ac20-5258708ed76c service nova] Creating event network-changed:f73f919a-97c7-4339-b316-1192335f4fa0 for instance 6a780ece-54a3-4348-a484-8cc1fd983934 on hv-cinder-83607 May 26 16:44:29.919140 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-341815b8-6a73-432d-af94-5f0f402bcdcf req-f7045eba-8687-461d-ac20-5258708ed76c service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144162 May 26 16:44:29.923721 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 218/436] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:44:30.404286 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-806b0fdd-5a16-4f5a-a1c6-de0ea0e4d551 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:44:30.419551 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-806b0fdd-5a16-4f5a-a1c6-de0ea0e4d551 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1374 microversion: 2.1 time: 0.704701 May 26 16:44:30.432125 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 219/437] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:44:29 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1374 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:44:31.440448 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-87efbf2a-e50a-4f2d-a486-63484f3e17a3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:44:31.441170 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-87efbf2a-e50a-4f2d-a486-63484f3e17a3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:44:31.453880 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-87efbf2a-e50a-4f2d-a486-63484f3e17a3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:31.454601 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-87efbf2a-e50a-4f2d-a486-63484f3e17a3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:31.455590 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-87efbf2a-e50a-4f2d-a486-63484f3e17a3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:31.456193 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-87efbf2a-e50a-4f2d-a486-63484f3e17a3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:31.926053 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-87efbf2a-e50a-4f2d-a486-63484f3e17a3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:44:31.954439 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-87efbf2a-e50a-4f2d-a486-63484f3e17a3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1374 microversion: 2.1 time: 0.514337 May 26 16:44:31.964706 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 219/438] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:44:31 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1374 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:44:32.993203 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ae8dc22e-bcd8-4f3a-83de-f76e88e8f364 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:44:32.994839 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ae8dc22e-bcd8-4f3a-83de-f76e88e8f364 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:44:33.019046 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ae8dc22e-bcd8-4f3a-83de-f76e88e8f364 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:33.022418 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ae8dc22e-bcd8-4f3a-83de-f76e88e8f364 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:33.037587 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ae8dc22e-bcd8-4f3a-83de-f76e88e8f364 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:33.051238 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ae8dc22e-bcd8-4f3a-83de-f76e88e8f364 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:34.153959 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ae8dc22e-bcd8-4f3a-83de-f76e88e8f364 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:44:34.182227 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ae8dc22e-bcd8-4f3a-83de-f76e88e8f364 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1374 microversion: 2.1 time: 1.213511 May 26 16:44:34.193156 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 220/439] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:44:32 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1374 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:44:35.208334 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-50760488-b297-46f7-b885-73495a3b22c3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:44:35.208983 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-50760488-b297-46f7-b885-73495a3b22c3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:44:35.215951 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell0:SELECT=2 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:35.218229 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell0:SELECT=6 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:35.224035 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:35.263102 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-50760488-b297-46f7-b885-73495a3b22c3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:35.265181 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-50760488-b297-46f7-b885-73495a3b22c3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:35.269090 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-50760488-b297-46f7-b885-73495a3b22c3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:35.270127 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-50760488-b297-46f7-b885-73495a3b22c3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:35.727493 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-50760488-b297-46f7-b885-73495a3b22c3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:44:35.737124 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-50760488-b297-46f7-b885-73495a3b22c3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1374 microversion: 2.1 time: 0.534037 May 26 16:44:35.748760 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 220/440] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:44:35 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1374 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:44:36.756302 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-30aa5b9c-451d-493b-a529-fa350a09d241 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:44:36.758557 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-30aa5b9c-451d-493b-a529-fa350a09d241 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:44:36.762881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=6 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:36.764723 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:36.778412 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-30aa5b9c-451d-493b-a529-fa350a09d241 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:36.781982 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-30aa5b9c-451d-493b-a529-fa350a09d241 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:36.783060 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-30aa5b9c-451d-493b-a529-fa350a09d241 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:36.787276 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-30aa5b9c-451d-493b-a529-fa350a09d241 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:37.270999 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-30aa5b9c-451d-493b-a529-fa350a09d241 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:44:37.322426 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-30aa5b9c-451d-493b-a529-fa350a09d241 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1374 microversion: 2.1 time: 0.567518 May 26 16:44:37.341642 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 221/441] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:44:36 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1374 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:44:38.347131 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-f565b503-2d35-4ad3-8c43-6d01d6fe25b8 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:44:38.347988 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-f565b503-2d35-4ad3-8c43-6d01d6fe25b8 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:44:38.357229 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f565b503-2d35-4ad3-8c43-6d01d6fe25b8 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:38.359557 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f565b503-2d35-4ad3-8c43-6d01d6fe25b8 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:38.360737 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f565b503-2d35-4ad3-8c43-6d01d6fe25b8 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:38.362771 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f565b503-2d35-4ad3-8c43-6d01d6fe25b8 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:38.685242 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-f565b503-2d35-4ad3-8c43-6d01d6fe25b8 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:44:38.703763 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-f565b503-2d35-4ad3-8c43-6d01d6fe25b8 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1374 microversion: 2.1 time: 0.359178 May 26 16:44:38.705671 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 221/442] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:44:38 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1374 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:44:38.804030 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 16:44:38.804513 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Thu May 26 16:44:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 16:44:39.722162 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e4595729-fd3a-4b41-9b36-8f11d4367c85 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:44:39.723393 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e4595729-fd3a-4b41-9b36-8f11d4367c85 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:44:39.741553 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e4595729-fd3a-4b41-9b36-8f11d4367c85 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:39.742274 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e4595729-fd3a-4b41-9b36-8f11d4367c85 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:39.743260 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e4595729-fd3a-4b41-9b36-8f11d4367c85 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:39.743865 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e4595729-fd3a-4b41-9b36-8f11d4367c85 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:40.016603 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e4595729-fd3a-4b41-9b36-8f11d4367c85 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:44:40.026939 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e4595729-fd3a-4b41-9b36-8f11d4367c85 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1374 microversion: 2.1 time: 0.308854 May 26 16:44:40.042216 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 222/443] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:44:39 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1374 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:44:41.058637 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-25f61fea-0b88-4235-aa6c-5ef9d1c31dc2 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:44:41.059847 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-25f61fea-0b88-4235-aa6c-5ef9d1c31dc2 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:44:41.090536 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-25f61fea-0b88-4235-aa6c-5ef9d1c31dc2 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:41.100895 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-25f61fea-0b88-4235-aa6c-5ef9d1c31dc2 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:41.104819 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-25f61fea-0b88-4235-aa6c-5ef9d1c31dc2 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:41.118374 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-25f61fea-0b88-4235-aa6c-5ef9d1c31dc2 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:41.460525 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-d51315f4-3c0d-4b5c-a1ba-939b87d9d7d3 req-21f4c8a1-d1d8-43e8-b368-28b047428267 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a780ece-54a3-4348-a484-8cc1fd983934", "name": "network-vif-plugged", "status": "completed", "tag": "f73f919a-97c7-4339-b316-1192335f4fa0"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:44:41.491036 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-d51315f4-3c0d-4b5c-a1ba-939b87d9d7d3 req-21f4c8a1-d1d8-43e8-b368-28b047428267 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:41.491565 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-d51315f4-3c0d-4b5c-a1ba-939b87d9d7d3 req-21f4c8a1-d1d8-43e8-b368-28b047428267 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:41.544199 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-d51315f4-3c0d-4b5c-a1ba-939b87d9d7d3 req-21f4c8a1-d1d8-43e8-b368-28b047428267 service nova] Creating event network-vif-plugged:f73f919a-97c7-4339-b316-1192335f4fa0 for instance 6a780ece-54a3-4348-a484-8cc1fd983934 on hv-cinder-83607 May 26 16:44:41.560890 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-d51315f4-3c0d-4b5c-a1ba-939b87d9d7d3 req-21f4c8a1-d1d8-43e8-b368-28b047428267 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105206 May 26 16:44:41.566537 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 223/444] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:44:41.648919 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-25f61fea-0b88-4235-aa6c-5ef9d1c31dc2 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:44:41.657545 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-25f61fea-0b88-4235-aa6c-5ef9d1c31dc2 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1374 microversion: 2.1 time: 0.611011 May 26 16:44:41.662035 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 222/445] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:44:41 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1374 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:44:42.689877 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-555fa3f1-2a94-4dad-8b90-680572e7259c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:44:42.691350 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-555fa3f1-2a94-4dad-8b90-680572e7259c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:44:42.700980 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-555fa3f1-2a94-4dad-8b90-680572e7259c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:42.701722 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-555fa3f1-2a94-4dad-8b90-680572e7259c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:42.702717 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-555fa3f1-2a94-4dad-8b90-680572e7259c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:42.703365 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-555fa3f1-2a94-4dad-8b90-680572e7259c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:43.063779 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-555fa3f1-2a94-4dad-8b90-680572e7259c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:44:43.084586 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-555fa3f1-2a94-4dad-8b90-680572e7259c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1374 microversion: 2.1 time: 0.400084 May 26 16:44:43.093632 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 224/446] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:44:42 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1374 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:44:44.123604 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-39fa5ebe-f458-47fa-a99f-223962b9ac81 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:44:44.131257 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-39fa5ebe-f458-47fa-a99f-223962b9ac81 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:44:44.161815 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-39fa5ebe-f458-47fa-a99f-223962b9ac81 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:44.163522 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-39fa5ebe-f458-47fa-a99f-223962b9ac81 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:44.166116 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-39fa5ebe-f458-47fa-a99f-223962b9ac81 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:44.168758 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-39fa5ebe-f458-47fa-a99f-223962b9ac81 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:44.688308 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-39fa5ebe-f458-47fa-a99f-223962b9ac81 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:44:44.699355 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-39fa5ebe-f458-47fa-a99f-223962b9ac81 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1374 microversion: 2.1 time: 0.584528 May 26 16:44:44.700688 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 223/447] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:44:44 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1374 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:44:45.743445 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-4eaa90cc-3119-49e8-b467-28f398642b4b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:44:45.745668 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-4eaa90cc-3119-49e8-b467-28f398642b4b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:44:45.760011 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4eaa90cc-3119-49e8-b467-28f398642b4b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:45.767490 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4eaa90cc-3119-49e8-b467-28f398642b4b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:45.770358 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4eaa90cc-3119-49e8-b467-28f398642b4b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:45.774593 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4eaa90cc-3119-49e8-b467-28f398642b4b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:46.143465 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-4eaa90cc-3119-49e8-b467-28f398642b4b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:44:46.159914 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-4eaa90cc-3119-49e8-b467-28f398642b4b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1567 microversion: 2.1 time: 0.422341 May 26 16:44:46.161137 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 225/448] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:44:45 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1567 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:44:46.178498 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-c1c7b983-0bbf-4b24-91e8-53604cbebe27 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:44:46.179089 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-c1c7b983-0bbf-4b24-91e8-53604cbebe27 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:44:46.199924 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c1c7b983-0bbf-4b24-91e8-53604cbebe27 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:46.200445 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c1c7b983-0bbf-4b24-91e8-53604cbebe27 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:46.201296 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c1c7b983-0bbf-4b24-91e8-53604cbebe27 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:46.218936 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c1c7b983-0bbf-4b24-91e8-53604cbebe27 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:46.464006 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-c1c7b983-0bbf-4b24-91e8-53604cbebe27 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.289952 May 26 16:44:46.470874 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 224/449] 10.222.0.102 () {58 vars in 1279 bytes} [Thu May 26 16:44:46 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934/os-interface => generated 284 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:44:48.496856 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-9f8bf23c-ff9a-4444-a51b-50e018805822 req-1524bc93-cf3b-40f5-b47b-9eda0c65e5f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a780ece-54a3-4348-a484-8cc1fd983934", "tag": "f73f919a-97c7-4339-b316-1192335f4fa0"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:44:48.519769 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-9f8bf23c-ff9a-4444-a51b-50e018805822 req-1524bc93-cf3b-40f5-b47b-9eda0c65e5f3 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:48.523052 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-9f8bf23c-ff9a-4444-a51b-50e018805822 req-1524bc93-cf3b-40f5-b47b-9eda0c65e5f3 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:48.561317 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-9f8bf23c-ff9a-4444-a51b-50e018805822 req-1524bc93-cf3b-40f5-b47b-9eda0c65e5f3 service nova] Creating event network-changed:f73f919a-97c7-4339-b316-1192335f4fa0 for instance 6a780ece-54a3-4348-a484-8cc1fd983934 on hv-cinder-83607 May 26 16:44:48.576162 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-9f8bf23c-ff9a-4444-a51b-50e018805822 req-1524bc93-cf3b-40f5-b47b-9eda0c65e5f3 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083538 May 26 16:44:48.577122 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 226/450] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:44:53.180505 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-8725ebea-ce89-4acd-9e3f-84c461d282e4 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Action: 'create', calling method: .version_select at 0x7f93a3f59670>, body: {"keypair": {"name": "tempest-TestShelveInstance-1311331693", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlacJr69FgDuE1erp7rtosm+V39sWvNMvSySKlA1U+dzWZcTRPKOTBW9VYF3yAkIAoe63KAK+0o1GT+wA6bqhKz5H0CDPjyyekIAdB2A6GozNqKmOPNJ4shyFlqCIeMBw=="}} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:44:53.251208 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.quota [None req-8725ebea-ce89-4acd-9e3f-84c461d282e4 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Getting quotas for project a5ffc538830947bbbfd272fb857cbc03. Resources: {'key_pairs'} {{(pid=124267) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:44:53.292782 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.quota [None req-8725ebea-ce89-4acd-9e3f-84c461d282e4 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Getting quotas for user c2f7cb90a5d74658ac55943d37d28737 and project a5ffc538830947bbbfd272fb857cbc03. Resources: {'key_pairs'} {{(pid=124267) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:44:53.417013 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-8725ebea-ce89-4acd-9e3f-84c461d282e4 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.726401 May 26 16:44:53.418178 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 225/451] 10.222.0.102 () {60 vars in 1163 bytes} [Thu May 26 16:44:52 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:44:58.496884 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d81c40ea-e5f1-4d4e-90ab-343b25410a0c tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Action: 'create', calling method: .version_select at 0x7f93a3da03a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1617699610", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF86IN+d37X+1+MTrTtG6Wm3GFPWB9P2bKYtoKbtIil4T00cfDth7xKacjWahDHAbj7SYOktbBNG4gL0XbgQUF2mkWqUBzJ2krff0wUdKp/5z+hlpx5YrXW6Mq3HGB4VBg=="}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:44:58.512016 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-d81c40ea-e5f1-4d4e-90ab-343b25410a0c tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Getting quotas for project 7fa63b33258040739dd6367d959c2250. Resources: {'key_pairs'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:44:58.517599 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-d81c40ea-e5f1-4d4e-90ab-343b25410a0c tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Getting quotas for user bb976c109cca488aa7317c71b54e5002 and project 7fa63b33258040739dd6367d959c2250. Resources: {'key_pairs'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:44:58.553934 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d81c40ea-e5f1-4d4e-90ab-343b25410a0c tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.061755 May 26 16:44:58.555084 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 227/452] 10.222.0.102 () {60 vars in 1163 bytes} [Thu May 26 16:44:58 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:44:58.703113 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-534302df-7a25-4524-8b2b-936b141316d7 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1730092814", "imageRef": "ebb0c7ef-50c3-42b2-ba9c-1116d1480eb9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1617699610", "networks": [{"uuid": "6cd4bf3c-789a-4d24-939f-1b91ffc9b209"}]}} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:44:58.712338 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=50 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:58.782477 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.network.neutron [None req-534302df-7a25-4524-8b2b-936b141316d7 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] validate_networks() for [('6cd4bf3c-789a-4d24-939f-1b91ffc9b209', None, None, None, None, None)] {{(pid=124267) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:44:59.205093 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-534302df-7a25-4524-8b2b-936b141316d7 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Flavor limits 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:44:59.205626 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-534302df-7a25-4524-8b2b-936b141316d7 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Image limits 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:44:59.206358 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-534302df-7a25-4524-8b2b-936b141316d7 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Flavor pref 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:44:59.206926 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-534302df-7a25-4524-8b2b-936b141316d7 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Image pref 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:44:59.207602 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-534302df-7a25-4524-8b2b-936b141316d7 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:44:59.219451 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-534302df-7a25-4524-8b2b-936b141316d7 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:59.220251 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-534302df-7a25-4524-8b2b-936b141316d7 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:59.221401 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-534302df-7a25-4524-8b2b-936b141316d7 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:44:59.221931 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-534302df-7a25-4524-8b2b-936b141316d7 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:44:59.239679 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.quota [None req-534302df-7a25-4524-8b2b-936b141316d7 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Getting quotas for project 7fa63b33258040739dd6367d959c2250. Resources: {'cores', 'instances', 'ram'} {{(pid=124267) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:44:59.244555 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.quota [None req-534302df-7a25-4524-8b2b-936b141316d7 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Getting quotas for user bb976c109cca488aa7317c71b54e5002 and project 7fa63b33258040739dd6367d959c2250. Resources: {'cores', 'instances', 'ram'} {{(pid=124267) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:44:59.260258 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-534302df-7a25-4524-8b2b-936b141316d7 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Going to run 1 instances... {{(pid=124267) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:44:59.263136 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-534302df-7a25-4524-8b2b-936b141316d7 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ebb0c7ef-50c3-42b2-ba9c-1116d1480eb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:44:59.316907 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-534302df-7a25-4524-8b2b-936b141316d7 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.619467 May 26 16:44:59.317800 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 226/453] 10.222.0.102 () {60 vars in 1151 bytes} [Thu May 26 16:44:58 2022] POST /compute/v2.1/servers => generated 382 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 16:44:59.325152 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=46 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:59.329491 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-b8f0d26a-c5fc-4e4c-9ce8-ac53063c1876 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:44:59.330213 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-b8f0d26a-c5fc-4e4c-9ce8-ac53063c1876 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:44:59.410400 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b8f0d26a-c5fc-4e4c-9ce8-ac53063c1876 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:44:59.419391 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-b8f0d26a-c5fc-4e4c-9ce8-ac53063c1876 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1263 microversion: 2.1 time: 0.094969 May 26 16:44:59.419985 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 228/454] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:44:59 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1263 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:00.446190 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-0165b1fa-ccc1-4c59-8ac6-44d56d24f5ed tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:00.451244 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-0165b1fa-ccc1-4c59-8ac6-44d56d24f5ed tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:00.472054 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0165b1fa-ccc1-4c59-8ac6-44d56d24f5ed tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:00.472835 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0165b1fa-ccc1-4c59-8ac6-44d56d24f5ed tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:00.473677 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0165b1fa-ccc1-4c59-8ac6-44d56d24f5ed tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:00.474125 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0165b1fa-ccc1-4c59-8ac6-44d56d24f5ed tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:00.561798 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-0165b1fa-ccc1-4c59-8ac6-44d56d24f5ed tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:00.570790 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-0165b1fa-ccc1-4c59-8ac6-44d56d24f5ed tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1315 microversion: 2.1 time: 0.135711 May 26 16:45:00.571377 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 227/455] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:00 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1315 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:01.597079 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-5196c7a7-91fa-44ac-993c-3201a6f13718 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:01.597079 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-5196c7a7-91fa-44ac-993c-3201a6f13718 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:01.623982 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5196c7a7-91fa-44ac-993c-3201a6f13718 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:01.624954 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5196c7a7-91fa-44ac-993c-3201a6f13718 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:01.626599 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5196c7a7-91fa-44ac-993c-3201a6f13718 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:01.627757 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5196c7a7-91fa-44ac-993c-3201a6f13718 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:01.774218 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-5196c7a7-91fa-44ac-993c-3201a6f13718 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:01.790035 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-5196c7a7-91fa-44ac-993c-3201a6f13718 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1321 microversion: 2.1 time: 0.205181 May 26 16:45:01.792603 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 229/456] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:01 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:02.807825 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-c6db1d9d-4848-49db-bc4c-2858c565ebc2 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:02.808469 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-c6db1d9d-4848-49db-bc4c-2858c565ebc2 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:02.814845 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c6db1d9d-4848-49db-bc4c-2858c565ebc2 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:02.815290 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c6db1d9d-4848-49db-bc4c-2858c565ebc2 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:02.816068 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c6db1d9d-4848-49db-bc4c-2858c565ebc2 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:02.816538 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c6db1d9d-4848-49db-bc4c-2858c565ebc2 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:02.952693 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-c6db1d9d-4848-49db-bc4c-2858c565ebc2 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:02.960126 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-c6db1d9d-4848-49db-bc4c-2858c565ebc2 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1363 microversion: 2.1 time: 0.156397 May 26 16:45:02.960722 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 228/457] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:02 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:03.980960 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-c6b1b767-6a1c-40be-be1f-12de49887667 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:03.982442 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-c6b1b767-6a1c-40be-be1f-12de49887667 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:03.989653 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c6b1b767-6a1c-40be-be1f-12de49887667 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:03.990110 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c6b1b767-6a1c-40be-be1f-12de49887667 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:03.990951 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c6b1b767-6a1c-40be-be1f-12de49887667 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:03.991395 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c6b1b767-6a1c-40be-be1f-12de49887667 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:04.162836 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c6b1b767-6a1c-40be-be1f-12de49887667 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:04.175217 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-c6b1b767-6a1c-40be-be1f-12de49887667 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1363 microversion: 2.1 time: 0.201619 May 26 16:45:04.175804 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 230/458] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:03 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:05.191472 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-dde48db0-b324-4341-a38f-48acb379e80b tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:05.192019 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-dde48db0-b324-4341-a38f-48acb379e80b tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:05.199725 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-dde48db0-b324-4341-a38f-48acb379e80b tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:05.200186 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-dde48db0-b324-4341-a38f-48acb379e80b tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:05.201042 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-dde48db0-b324-4341-a38f-48acb379e80b tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:05.201494 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-dde48db0-b324-4341-a38f-48acb379e80b tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:05.343258 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-dde48db0-b324-4341-a38f-48acb379e80b tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:05.351335 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-dde48db0-b324-4341-a38f-48acb379e80b tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1363 microversion: 2.1 time: 0.164138 May 26 16:45:05.351894 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 229/459] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:05 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:06.368405 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-4a172540-c6f0-48f1-aeb5-8676d924d5a8 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:06.371800 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-4a172540-c6f0-48f1-aeb5-8676d924d5a8 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:06.376304 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4a172540-c6f0-48f1-aeb5-8676d924d5a8 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:06.377163 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4a172540-c6f0-48f1-aeb5-8676d924d5a8 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:06.377951 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4a172540-c6f0-48f1-aeb5-8676d924d5a8 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:06.378534 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4a172540-c6f0-48f1-aeb5-8676d924d5a8 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:06.548128 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-4a172540-c6f0-48f1-aeb5-8676d924d5a8 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:06.557050 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-4a172540-c6f0-48f1-aeb5-8676d924d5a8 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1363 microversion: 2.1 time: 0.193413 May 26 16:45:06.567218 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 231/460] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:06 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:07.575754 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-02f9269b-ae3e-451d-8206-155a65e21e26 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:07.576482 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-02f9269b-ae3e-451d-8206-155a65e21e26 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:07.578185 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=4 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:07.583893 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-02f9269b-ae3e-451d-8206-155a65e21e26 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:07.584490 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-02f9269b-ae3e-451d-8206-155a65e21e26 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:07.585288 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-02f9269b-ae3e-451d-8206-155a65e21e26 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:07.585717 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-02f9269b-ae3e-451d-8206-155a65e21e26 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:07.726265 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-02f9269b-ae3e-451d-8206-155a65e21e26 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:07.733010 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-02f9269b-ae3e-451d-8206-155a65e21e26 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1363 microversion: 2.1 time: 0.161524 May 26 16:45:07.733591 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 230/461] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:07 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:08.750331 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9fd7c551-7a9c-4e5c-8057-30a24b43ca61 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:08.750951 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9fd7c551-7a9c-4e5c-8057-30a24b43ca61 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:08.753324 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:08.758823 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9fd7c551-7a9c-4e5c-8057-30a24b43ca61 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:08.759286 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9fd7c551-7a9c-4e5c-8057-30a24b43ca61 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:08.760056 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9fd7c551-7a9c-4e5c-8057-30a24b43ca61 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:08.760611 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9fd7c551-7a9c-4e5c-8057-30a24b43ca61 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:08.894738 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9fd7c551-7a9c-4e5c-8057-30a24b43ca61 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:08.902534 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9fd7c551-7a9c-4e5c-8057-30a24b43ca61 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1363 microversion: 2.1 time: 0.156377 May 26 16:45:08.903095 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 232/462] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:08 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:09.921076 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-526b2cab-5862-44e0-a406-fdc207ef2bd3 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:09.921995 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-526b2cab-5862-44e0-a406-fdc207ef2bd3 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:09.923805 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell0:SELECT=2 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:09.924633 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell0:SELECT=10 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:09.931973 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-526b2cab-5862-44e0-a406-fdc207ef2bd3 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:09.932504 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-526b2cab-5862-44e0-a406-fdc207ef2bd3 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:09.933248 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-526b2cab-5862-44e0-a406-fdc207ef2bd3 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:09.933693 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-526b2cab-5862-44e0-a406-fdc207ef2bd3 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:10.111049 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-526b2cab-5862-44e0-a406-fdc207ef2bd3 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:10.119434 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-526b2cab-5862-44e0-a406-fdc207ef2bd3 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1363 microversion: 2.1 time: 0.203236 May 26 16:45:10.120339 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 231/463] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:09 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:11.135875 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e916b619-98b2-4ba9-b00c-635a39b22b19 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:11.137436 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e916b619-98b2-4ba9-b00c-635a39b22b19 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:11.143723 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=6 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:11.147780 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e916b619-98b2-4ba9-b00c-635a39b22b19 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:11.148880 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e916b619-98b2-4ba9-b00c-635a39b22b19 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:11.149961 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e916b619-98b2-4ba9-b00c-635a39b22b19 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:11.150681 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e916b619-98b2-4ba9-b00c-635a39b22b19 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:11.306213 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e916b619-98b2-4ba9-b00c-635a39b22b19 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:11.326727 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e916b619-98b2-4ba9-b00c-635a39b22b19 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1363 microversion: 2.1 time: 0.194566 May 26 16:45:11.331764 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 233/464] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:11 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:12.349354 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-815664d7-9c2a-464d-9086-eaa852ee1bec tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:12.351990 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-815664d7-9c2a-464d-9086-eaa852ee1bec tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:12.359484 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-815664d7-9c2a-464d-9086-eaa852ee1bec tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:12.360046 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-815664d7-9c2a-464d-9086-eaa852ee1bec tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:12.360883 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-815664d7-9c2a-464d-9086-eaa852ee1bec tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:12.361408 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-815664d7-9c2a-464d-9086-eaa852ee1bec tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:12.515858 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-815664d7-9c2a-464d-9086-eaa852ee1bec tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:12.525952 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-815664d7-9c2a-464d-9086-eaa852ee1bec tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1363 microversion: 2.1 time: 0.183490 May 26 16:45:12.526546 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 232/465] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:12 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:13.542190 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-31fa132b-cae2-48c2-9e2b-a91efef15e61 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:13.542819 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-31fa132b-cae2-48c2-9e2b-a91efef15e61 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:13.549240 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-31fa132b-cae2-48c2-9e2b-a91efef15e61 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:13.549720 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-31fa132b-cae2-48c2-9e2b-a91efef15e61 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:13.550483 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-31fa132b-cae2-48c2-9e2b-a91efef15e61 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:13.550921 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-31fa132b-cae2-48c2-9e2b-a91efef15e61 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:13.683016 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-31fa132b-cae2-48c2-9e2b-a91efef15e61 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:13.690427 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-31fa132b-cae2-48c2-9e2b-a91efef15e61 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1363 microversion: 2.1 time: 0.152126 May 26 16:45:13.690990 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 234/466] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:13 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:14.709016 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-49e8e6c8-d9d3-47b1-a89f-efe640c5dcf3 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:14.710205 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-49e8e6c8-d9d3-47b1-a89f-efe640c5dcf3 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:14.716505 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-49e8e6c8-d9d3-47b1-a89f-efe640c5dcf3 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:14.717246 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-49e8e6c8-d9d3-47b1-a89f-efe640c5dcf3 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:14.718026 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-49e8e6c8-d9d3-47b1-a89f-efe640c5dcf3 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:14.718459 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-49e8e6c8-d9d3-47b1-a89f-efe640c5dcf3 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:14.848038 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-49e8e6c8-d9d3-47b1-a89f-efe640c5dcf3 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:14.855429 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-49e8e6c8-d9d3-47b1-a89f-efe640c5dcf3 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1363 microversion: 2.1 time: 0.151142 May 26 16:45:14.855993 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 233/467] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:14 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:15.874140 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0ea2b449-5c10-47d1-bc09-d1d3d7ad2752 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:15.874742 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0ea2b449-5c10-47d1-bc09-d1d3d7ad2752 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:15.882454 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0ea2b449-5c10-47d1-bc09-d1d3d7ad2752 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:15.882906 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0ea2b449-5c10-47d1-bc09-d1d3d7ad2752 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:15.883688 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0ea2b449-5c10-47d1-bc09-d1d3d7ad2752 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:15.884125 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0ea2b449-5c10-47d1-bc09-d1d3d7ad2752 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:16.042668 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0ea2b449-5c10-47d1-bc09-d1d3d7ad2752 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:16.051429 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0ea2b449-5c10-47d1-bc09-d1d3d7ad2752 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1363 microversion: 2.1 time: 0.181080 May 26 16:45:16.051966 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 235/468] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:15 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:17.069168 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-578908fe-5cd1-40a0-aecf-725d9ea40f37 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:17.070412 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-578908fe-5cd1-40a0-aecf-725d9ea40f37 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:17.076570 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-578908fe-5cd1-40a0-aecf-725d9ea40f37 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:17.077597 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-578908fe-5cd1-40a0-aecf-725d9ea40f37 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:17.077845 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-578908fe-5cd1-40a0-aecf-725d9ea40f37 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:17.078280 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-578908fe-5cd1-40a0-aecf-725d9ea40f37 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:17.206881 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-578908fe-5cd1-40a0-aecf-725d9ea40f37 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:17.215430 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-578908fe-5cd1-40a0-aecf-725d9ea40f37 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1363 microversion: 2.1 time: 0.150318 May 26 16:45:17.216005 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 234/469] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:17 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:18.232305 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-b343c2ef-ec65-4a69-9c66-a4dedcb33532 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:18.232944 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-b343c2ef-ec65-4a69-9c66-a4dedcb33532 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:18.239394 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b343c2ef-ec65-4a69-9c66-a4dedcb33532 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:18.239846 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b343c2ef-ec65-4a69-9c66-a4dedcb33532 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:18.240627 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b343c2ef-ec65-4a69-9c66-a4dedcb33532 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:18.241057 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b343c2ef-ec65-4a69-9c66-a4dedcb33532 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:18.374509 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b343c2ef-ec65-4a69-9c66-a4dedcb33532 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:18.382221 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-b343c2ef-ec65-4a69-9c66-a4dedcb33532 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1363 microversion: 2.1 time: 0.153898 May 26 16:45:18.382782 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 236/470] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:18 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:45:19.399078 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-09ccb13e-081d-40fa-a805-098b8e999335 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:19.400332 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-09ccb13e-081d-40fa-a805-098b8e999335 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:19.407028 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-09ccb13e-081d-40fa-a805-098b8e999335 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:19.407296 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-09ccb13e-081d-40fa-a805-098b8e999335 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:19.408356 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-09ccb13e-081d-40fa-a805-098b8e999335 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:19.409286 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-09ccb13e-081d-40fa-a805-098b8e999335 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:19.428704 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-470d5cd4-6549-414e-a195-f0d3bf957644 req-09eac3a3-357e-4c14-8a4a-539afd75203a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b7b9106-8559-47d1-93c5-3549d90ee4f8", "tag": "cca18761-4fc8-4413-bdd9-ee704f060a72"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:45:19.455710 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-470d5cd4-6549-414e-a195-f0d3bf957644 req-09eac3a3-357e-4c14-8a4a-539afd75203a service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:19.456164 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-470d5cd4-6549-414e-a195-f0d3bf957644 req-09eac3a3-357e-4c14-8a4a-539afd75203a service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:19.469532 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-470d5cd4-6549-414e-a195-f0d3bf957644 req-09eac3a3-357e-4c14-8a4a-539afd75203a service nova] Creating event network-changed:cca18761-4fc8-4413-bdd9-ee704f060a72 for instance 7b7b9106-8559-47d1-93c5-3549d90ee4f8 on hv-cinder-83607 May 26 16:45:19.476427 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-470d5cd4-6549-414e-a195-f0d3bf957644 req-09eac3a3-357e-4c14-8a4a-539afd75203a service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054808 May 26 16:45:19.476427 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 237/471] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:45:19.594346 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-09ccb13e-081d-40fa-a805-098b8e999335 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:19.604320 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-09ccb13e-081d-40fa-a805-098b8e999335 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1363 microversion: 2.1 time: 0.209115 May 26 16:45:19.605203 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 235/472] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:19 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:20.622732 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9ebb0688-584b-4b69-b80d-d7b507be0344 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:20.623371 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9ebb0688-584b-4b69-b80d-d7b507be0344 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:20.629756 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9ebb0688-584b-4b69-b80d-d7b507be0344 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:20.630209 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9ebb0688-584b-4b69-b80d-d7b507be0344 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:20.631564 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9ebb0688-584b-4b69-b80d-d7b507be0344 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:20.632598 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9ebb0688-584b-4b69-b80d-d7b507be0344 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:20.773094 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9ebb0688-584b-4b69-b80d-d7b507be0344 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:20.780532 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9ebb0688-584b-4b69-b80d-d7b507be0344 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1363 microversion: 2.1 time: 0.162560 May 26 16:45:20.781124 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 238/473] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:20 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:21.797332 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-685e811c-9954-4ef5-bd07-a4dc429b9956 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:21.797928 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-685e811c-9954-4ef5-bd07-a4dc429b9956 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:21.804105 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-685e811c-9954-4ef5-bd07-a4dc429b9956 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:21.804593 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-685e811c-9954-4ef5-bd07-a4dc429b9956 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:21.805370 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-685e811c-9954-4ef5-bd07-a4dc429b9956 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:21.805806 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-685e811c-9954-4ef5-bd07-a4dc429b9956 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:21.941084 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-685e811c-9954-4ef5-bd07-a4dc429b9956 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:21.950438 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-685e811c-9954-4ef5-bd07-a4dc429b9956 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1363 microversion: 2.1 time: 0.156683 May 26 16:45:21.951267 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 236/474] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:21 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:22.968184 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2225f256-fbe3-4f71-b7f3-e91142d094c6 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:22.968763 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2225f256-fbe3-4f71-b7f3-e91142d094c6 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:22.975950 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2225f256-fbe3-4f71-b7f3-e91142d094c6 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:22.976447 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2225f256-fbe3-4f71-b7f3-e91142d094c6 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:22.977220 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2225f256-fbe3-4f71-b7f3-e91142d094c6 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:22.977660 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2225f256-fbe3-4f71-b7f3-e91142d094c6 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:23.113910 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-2225f256-fbe3-4f71-b7f3-e91142d094c6 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:23.121465 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2225f256-fbe3-4f71-b7f3-e91142d094c6 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1363 microversion: 2.1 time: 0.157226 May 26 16:45:23.122032 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 239/475] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:22 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:24.138543 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-23722f20-07d1-400a-b513-3081aba9d9c9 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:24.139224 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-23722f20-07d1-400a-b513-3081aba9d9c9 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:24.145761 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-23722f20-07d1-400a-b513-3081aba9d9c9 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:24.146284 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-23722f20-07d1-400a-b513-3081aba9d9c9 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:24.147766 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-23722f20-07d1-400a-b513-3081aba9d9c9 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:24.148306 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-23722f20-07d1-400a-b513-3081aba9d9c9 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:24.297117 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-23722f20-07d1-400a-b513-3081aba9d9c9 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:24.316325 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-23722f20-07d1-400a-b513-3081aba9d9c9 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1363 microversion: 2.1 time: 0.181556 May 26 16:45:24.317347 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 237/476] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:24 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:25.344688 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-25a76f65-051a-4afe-8657-603de6f4b2da tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:25.345534 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-25a76f65-051a-4afe-8657-603de6f4b2da tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:25.353459 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-25a76f65-051a-4afe-8657-603de6f4b2da tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:25.353915 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-25a76f65-051a-4afe-8657-603de6f4b2da tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:25.354707 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-25a76f65-051a-4afe-8657-603de6f4b2da tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:25.355155 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-25a76f65-051a-4afe-8657-603de6f4b2da tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:25.516260 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-25a76f65-051a-4afe-8657-603de6f4b2da tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:25.529224 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-25a76f65-051a-4afe-8657-603de6f4b2da tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1363 microversion: 2.1 time: 0.188354 May 26 16:45:25.530282 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 240/477] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:25 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:26.556112 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-57496c20-7a79-46bd-999d-119513a52e78 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:26.556864 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-57496c20-7a79-46bd-999d-119513a52e78 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:26.563260 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-57496c20-7a79-46bd-999d-119513a52e78 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:26.563709 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-57496c20-7a79-46bd-999d-119513a52e78 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:26.564540 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-57496c20-7a79-46bd-999d-119513a52e78 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:26.564984 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-57496c20-7a79-46bd-999d-119513a52e78 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:26.991643 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-57496c20-7a79-46bd-999d-119513a52e78 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:27.000084 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-57496c20-7a79-46bd-999d-119513a52e78 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1363 microversion: 2.1 time: 0.448271 May 26 16:45:27.008432 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 238/478] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:26 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1363 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:45:28.024550 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-76e110bd-e191-490f-8779-710716ff759e tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:28.025485 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-76e110bd-e191-490f-8779-710716ff759e tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:28.037545 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-76e110bd-e191-490f-8779-710716ff759e tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:28.038612 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-76e110bd-e191-490f-8779-710716ff759e tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:28.040653 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-76e110bd-e191-490f-8779-710716ff759e tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:28.041747 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-76e110bd-e191-490f-8779-710716ff759e tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:28.248010 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-76e110bd-e191-490f-8779-710716ff759e tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:28.261970 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-76e110bd-e191-490f-8779-710716ff759e tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1363 microversion: 2.1 time: 0.242856 May 26 16:45:28.263171 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 241/479] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:28 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:28.365131 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-a5c6b4fc-5e33-4279-93f0-23726f1654aa req-af293c1e-f212-452a-a407-7b7afda9e0fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b7b9106-8559-47d1-93c5-3549d90ee4f8", "name": "network-vif-plugged", "status": "completed", "tag": "cca18761-4fc8-4413-bdd9-ee704f060a72"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:45:28.374511 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-a5c6b4fc-5e33-4279-93f0-23726f1654aa req-af293c1e-f212-452a-a407-7b7afda9e0fb service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:28.374961 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-a5c6b4fc-5e33-4279-93f0-23726f1654aa req-af293c1e-f212-452a-a407-7b7afda9e0fb service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:28.387921 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-a5c6b4fc-5e33-4279-93f0-23726f1654aa req-af293c1e-f212-452a-a407-7b7afda9e0fb service nova] Creating event network-vif-plugged:cca18761-4fc8-4413-bdd9-ee704f060a72 for instance 7b7b9106-8559-47d1-93c5-3549d90ee4f8 on hv-cinder-83607 May 26 16:45:28.393930 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-a5c6b4fc-5e33-4279-93f0-23726f1654aa req-af293c1e-f212-452a-a407-7b7afda9e0fb service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039928 May 26 16:45:28.394825 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 239/480] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:45:29.287852 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-01e0be2a-e6b1-4e11-b68a-839c4473b336 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:29.288560 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-01e0be2a-e6b1-4e11-b68a-839c4473b336 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:29.295951 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-01e0be2a-e6b1-4e11-b68a-839c4473b336 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:29.296538 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-01e0be2a-e6b1-4e11-b68a-839c4473b336 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:29.297468 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-01e0be2a-e6b1-4e11-b68a-839c4473b336 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:29.297971 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-01e0be2a-e6b1-4e11-b68a-839c4473b336 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:29.435425 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-01e0be2a-e6b1-4e11-b68a-839c4473b336 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:29.438483 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=79 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:29.448908 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-01e0be2a-e6b1-4e11-b68a-839c4473b336 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1363 microversion: 2.1 time: 0.165586 May 26 16:45:29.449506 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 242/481] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:29 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:45:30.467798 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-5b664623-dcc4-49d1-9a0a-16f975bc4a86 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:30.468452 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-5b664623-dcc4-49d1-9a0a-16f975bc4a86 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:30.474887 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-5b664623-dcc4-49d1-9a0a-16f975bc4a86 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:30.475330 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-5b664623-dcc4-49d1-9a0a-16f975bc4a86 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:30.476098 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-5b664623-dcc4-49d1-9a0a-16f975bc4a86 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:30.476560 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-5b664623-dcc4-49d1-9a0a-16f975bc4a86 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:30.479259 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=77 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:30.614522 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-5b664623-dcc4-49d1-9a0a-16f975bc4a86 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:30.623010 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-5b664623-dcc4-49d1-9a0a-16f975bc4a86 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1363 microversion: 2.1 time: 0.159541 May 26 16:45:30.623589 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 240/482] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:30 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:31.639956 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-838db41e-5d21-40c5-b1a8-85a7d9a489f1 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:31.640628 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-838db41e-5d21-40c5-b1a8-85a7d9a489f1 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:31.648004 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-838db41e-5d21-40c5-b1a8-85a7d9a489f1 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:31.648698 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-838db41e-5d21-40c5-b1a8-85a7d9a489f1 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:31.649280 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-838db41e-5d21-40c5-b1a8-85a7d9a489f1 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:31.649747 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-838db41e-5d21-40c5-b1a8-85a7d9a489f1 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:31.785327 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-838db41e-5d21-40c5-b1a8-85a7d9a489f1 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:31.793414 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-838db41e-5d21-40c5-b1a8-85a7d9a489f1 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1363 microversion: 2.1 time: 0.158138 May 26 16:45:31.794046 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 243/483] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:31 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:32.810932 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-2795fcbe-7679-4237-8e5b-e11980c66a64 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:32.811522 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-2795fcbe-7679-4237-8e5b-e11980c66a64 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:32.817768 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2795fcbe-7679-4237-8e5b-e11980c66a64 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:32.818214 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2795fcbe-7679-4237-8e5b-e11980c66a64 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:32.819488 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2795fcbe-7679-4237-8e5b-e11980c66a64 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:32.820412 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2795fcbe-7679-4237-8e5b-e11980c66a64 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:32.956701 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-2795fcbe-7679-4237-8e5b-e11980c66a64 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:32.965403 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-2795fcbe-7679-4237-8e5b-e11980c66a64 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1552 microversion: 2.1 time: 0.158402 May 26 16:45:32.965996 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 241/484] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:32 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1552 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:32.981629 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a3e25de4-cbb1-405a-a422-45d1e875b89e tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:32.982234 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a3e25de4-cbb1-405a-a422-45d1e875b89e tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:32.988798 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a3e25de4-cbb1-405a-a422-45d1e875b89e tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:32.989247 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a3e25de4-cbb1-405a-a422-45d1e875b89e tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:32.990013 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a3e25de4-cbb1-405a-a422-45d1e875b89e tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:32.990450 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a3e25de4-cbb1-405a-a422-45d1e875b89e tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:33.123377 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a3e25de4-cbb1-405a-a422-45d1e875b89e tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:33.131089 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a3e25de4-cbb1-405a-a422-45d1e875b89e tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1552 microversion: 2.1 time: 0.153321 May 26 16:45:33.132218 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 244/485] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:32 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:33.135665 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-5cc40999-7c5f-4f74-acfc-c14f0854f012 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2068424857", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1311331693", "security_groups": [{"name": "tempest-secgroup-smoke-460387950"}], "networks": [{"uuid": "a3233510-2583-4141-a316-5cf97527e5f9"}], "block_device_mapping_v2": [{"uuid": "03d06cac-9497-4380-b4eb-3be2eafebf53", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:45:33.147495 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-438bc2b0-9cb9-4dac-9575-547aa61ab67e tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:33.151043 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-438bc2b0-9cb9-4dac-9575-547aa61ab67e tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:33.151815 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-438bc2b0-9cb9-4dac-9575-547aa61ab67e tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Searching by: {'deleted': False, 'project_id': '7fa63b33258040739dd6367d959c2250'} {{(pid=124266) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 26 16:45:33.159523 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-438bc2b0-9cb9-4dac-9575-547aa61ab67e tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:33.159970 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-438bc2b0-9cb9-4dac-9575-547aa61ab67e tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:33.160804 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-438bc2b0-9cb9-4dac-9575-547aa61ab67e tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:33.161283 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-438bc2b0-9cb9-4dac-9575-547aa61ab67e tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:33.252847 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.network.neutron [None req-5cc40999-7c5f-4f74-acfc-c14f0854f012 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] validate_networks() for [('a3233510-2583-4141-a316-5cf97527e5f9', None, None, None, None, None)] {{(pid=124267) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:45:33.254976 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.multi_cell_list [None req-438bc2b0-9cb9-4dac-9575-547aa61ab67e tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124266) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 26 16:45:33.356130 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-438bc2b0-9cb9-4dac-9575-547aa61ab67e tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers" status: 200 len: 345 microversion: 2.1 time: 0.212781 May 26 16:45:33.365442 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 245/486] 10.222.0.102 () {58 vars in 1129 bytes} [Thu May 26 16:45:33 2022] GET /compute/v2.1/servers => generated 345 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:45:33.370940 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-57a671c6-274c-4beb-ac01-a4acc0eee62f tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:33.371559 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-57a671c6-274c-4beb-ac01-a4acc0eee62f tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:33.377737 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-57a671c6-274c-4beb-ac01-a4acc0eee62f tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:33.378191 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-57a671c6-274c-4beb-ac01-a4acc0eee62f tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:33.378967 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-57a671c6-274c-4beb-ac01-a4acc0eee62f tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:33.379409 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-57a671c6-274c-4beb-ac01-a4acc0eee62f tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:33.602174 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-57a671c6-274c-4beb-ac01-a4acc0eee62f tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:33.610237 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-57a671c6-274c-4beb-ac01-a4acc0eee62f tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1552 microversion: 2.1 time: 0.243003 May 26 16:45:33.611106 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 246/487] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:33 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1552 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:45:33.718620 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-5cc40999-7c5f-4f74-acfc-c14f0854f012 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Flavor limits 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:45:33.719047 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-5cc40999-7c5f-4f74-acfc-c14f0854f012 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Image limits 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:45:33.719512 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-5cc40999-7c5f-4f74-acfc-c14f0854f012 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Flavor pref 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:45:33.719916 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-5cc40999-7c5f-4f74-acfc-c14f0854f012 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Image pref 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:45:33.720325 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-5cc40999-7c5f-4f74-acfc-c14f0854f012 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:45:33.731514 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-5cc40999-7c5f-4f74-acfc-c14f0854f012 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:33.731959 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-5cc40999-7c5f-4f74-acfc-c14f0854f012 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:33.732782 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-5cc40999-7c5f-4f74-acfc-c14f0854f012 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:33.733210 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-5cc40999-7c5f-4f74-acfc-c14f0854f012 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:33.753665 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.quota [None req-5cc40999-7c5f-4f74-acfc-c14f0854f012 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Getting quotas for project a5ffc538830947bbbfd272fb857cbc03. Resources: {'cores', 'instances', 'ram'} {{(pid=124267) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:45:33.758775 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.quota [None req-5cc40999-7c5f-4f74-acfc-c14f0854f012 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Getting quotas for user c2f7cb90a5d74658ac55943d37d28737 and project a5ffc538830947bbbfd272fb857cbc03. Resources: {'cores', 'instances', 'ram'} {{(pid=124267) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:45:33.841428 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-5cc40999-7c5f-4f74-acfc-c14f0854f012 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Going to run 1 instances... {{(pid=124267) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:45:33.843548 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-5cc40999-7c5f-4f74-acfc-c14f0854f012 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='03d06cac-9497-4380-b4eb-3be2eafebf53',volume_size=None,volume_type=None)] {{(pid=124267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:45:34.048922 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-5cc40999-7c5f-4f74-acfc-c14f0854f012 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.917470 May 26 16:45:34.049752 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 242/488] 10.222.0.102 () {60 vars in 1151 bytes} [Thu May 26 16:45:33 2022] POST /compute/v2.1/servers => generated 407 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) May 26 16:45:34.061146 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a9b0a02e-bb48-496e-a941-1892b036fe84 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:34.063584 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a9b0a02e-bb48-496e-a941-1892b036fe84 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:34.125778 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a9b0a02e-bb48-496e-a941-1892b036fe84 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:34.133066 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a9b0a02e-bb48-496e-a941-1892b036fe84 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1092 microversion: 2.1 time: 0.076403 May 26 16:45:34.133631 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 247/489] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:34 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1092 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:45:35.154927 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-cbf361e6-e36c-4c47-b32e-01eaa6929170 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:35.155563 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-cbf361e6-e36c-4c47-b32e-01eaa6929170 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:35.162868 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-cbf361e6-e36c-4c47-b32e-01eaa6929170 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:35.163317 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-cbf361e6-e36c-4c47-b32e-01eaa6929170 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:35.164092 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-cbf361e6-e36c-4c47-b32e-01eaa6929170 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:35.164559 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-cbf361e6-e36c-4c47-b32e-01eaa6929170 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:35.297860 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-cbf361e6-e36c-4c47-b32e-01eaa6929170 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:35.306939 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-cbf361e6-e36c-4c47-b32e-01eaa6929170 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1198 microversion: 2.1 time: 0.155733 May 26 16:45:35.307733 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 243/490] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:35 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1198 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:35.367138 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f4bb3227-47d6-42d9-905b-749065917859 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:35.367718 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f4bb3227-47d6-42d9-905b-749065917859 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:35.375385 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f4bb3227-47d6-42d9-905b-749065917859 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:35.375832 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f4bb3227-47d6-42d9-905b-749065917859 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:35.376696 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f4bb3227-47d6-42d9-905b-749065917859 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:35.377130 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f4bb3227-47d6-42d9-905b-749065917859 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:35.403772 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f4bb3227-47d6-42d9-905b-749065917859 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9/ips" status: 200 len: 153 microversion: 2.20 time: 0.040956 May 26 16:45:35.404574 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 248/491] 10.222.0.102 () {60 vars in 1293 bytes} [Thu May 26 16:45:35 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9/ips => generated 153 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 16:45:36.325120 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-34a785bc-c256-487a-ba1e-a009ead7aa98 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:36.326599 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-34a785bc-c256-487a-ba1e-a009ead7aa98 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:36.339661 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-71032870-0203-4641-bdb3-15be8f83a17c tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82c01545-e4e9-4432-b456-1716a2769a8a"}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:45:36.341327 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-71032870-0203-4641-bdb3-15be8f83a17c tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:36.348007 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-34a785bc-c256-487a-ba1e-a009ead7aa98 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:36.353387 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-71032870-0203-4641-bdb3-15be8f83a17c tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:36.353966 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-71032870-0203-4641-bdb3-15be8f83a17c tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:36.354978 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-71032870-0203-4641-bdb3-15be8f83a17c tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:36.355423 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-71032870-0203-4641-bdb3-15be8f83a17c tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:36.355830 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-34a785bc-c256-487a-ba1e-a009ead7aa98 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:36.356855 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-34a785bc-c256-487a-ba1e-a009ead7aa98 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:36.358437 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-34a785bc-c256-487a-ba1e-a009ead7aa98 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:36.574928 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-34a785bc-c256-487a-ba1e-a009ead7aa98 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:36.585776 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-34a785bc-c256-487a-ba1e-a009ead7aa98 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1275 microversion: 2.1 time: 0.264744 May 26 16:45:36.589082 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 244/492] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:36 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1275 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:36.779801 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-71032870-0203-4641-bdb3-15be8f83a17c tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "POST /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.445323 May 26 16:45:36.783021 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 249/493] 10.222.0.102 () {60 vars in 1327 bytes} [Thu May 26 16:45:36 2022] POST /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8/os-volume_attachments => generated 194 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:45:37.010716 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-9de9c552-0269-46c7-851d-13b20290c3c4 req-09886d9d-cb25-4f92-b3cb-6297ab8cd1fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "898074a4-2c24-403a-bdd9-e9809f6375fd", "tag": "a5a3472f-1b24-4c5b-ada9-48c5e198da12"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:45:37.019913 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-9de9c552-0269-46c7-851d-13b20290c3c4 req-09886d9d-cb25-4f92-b3cb-6297ab8cd1fe service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:37.020608 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-9de9c552-0269-46c7-851d-13b20290c3c4 req-09886d9d-cb25-4f92-b3cb-6297ab8cd1fe service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:37.047329 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-9de9c552-0269-46c7-851d-13b20290c3c4 req-09886d9d-cb25-4f92-b3cb-6297ab8cd1fe service nova] Creating event network-changed:a5a3472f-1b24-4c5b-ada9-48c5e198da12 for instance 898074a4-2c24-403a-bdd9-e9809f6375fd on hv-cinder-83607 May 26 16:45:37.052695 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-9de9c552-0269-46c7-851d-13b20290c3c4 req-09886d9d-cb25-4f92-b3cb-6297ab8cd1fe service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048640 May 26 16:45:37.053899 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 245/494] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:45:37.604918 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ec02b9da-3347-4514-bb5b-72589c24e90e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:37.605666 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ec02b9da-3347-4514-bb5b-72589c24e90e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:37.612080 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ec02b9da-3347-4514-bb5b-72589c24e90e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:37.612568 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ec02b9da-3347-4514-bb5b-72589c24e90e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:37.613369 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ec02b9da-3347-4514-bb5b-72589c24e90e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:37.613821 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ec02b9da-3347-4514-bb5b-72589c24e90e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:37.761346 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ec02b9da-3347-4514-bb5b-72589c24e90e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:37.771422 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ec02b9da-3347-4514-bb5b-72589c24e90e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1263 microversion: 2.1 time: 0.171540 May 26 16:45:37.781994 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 250/495] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:37 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1263 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:45:38.129526 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-bad83f0b-30d7-4d88-9582-9d282b6911b9 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:38.130067 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-bad83f0b-30d7-4d88-9582-9d282b6911b9 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:38.131875 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:38.137497 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bad83f0b-30d7-4d88-9582-9d282b6911b9 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:38.137950 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bad83f0b-30d7-4d88-9582-9d282b6911b9 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:38.138723 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bad83f0b-30d7-4d88-9582-9d282b6911b9 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:38.139162 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bad83f0b-30d7-4d88-9582-9d282b6911b9 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:38.165079 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-bad83f0b-30d7-4d88-9582-9d282b6911b9 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29/ips" status: 200 len: 146 microversion: 2.1 time: 0.040258 May 26 16:45:38.165659 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 246/496] 10.222.0.102 () {58 vars in 1252 bytes} [Thu May 26 16:45:38 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:45:38.437663 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-76b25fbc-3253-4f70-8e9f-f850a1b1888f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:45:38.438175 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-76b25fbc-3253-4f70-8e9f-f850a1b1888f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:38.444650 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-76b25fbc-3253-4f70-8e9f-f850a1b1888f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:38.445357 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-76b25fbc-3253-4f70-8e9f-f850a1b1888f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:38.446125 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-76b25fbc-3253-4f70-8e9f-f850a1b1888f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:38.446562 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-76b25fbc-3253-4f70-8e9f-f850a1b1888f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:38.473823 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.objects.instance [None req-76b25fbc-3253-4f70-8e9f-f850a1b1888f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lazy-loading 'flavor' on Instance uuid a636d450-9d10-45a5-9982-9e10393fc4a9 {{(pid=124266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:45:38.743477 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-76b25fbc-3253-4f70-8e9f-f850a1b1888f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "POST /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9/action" status: 202 len: 0 microversion: 2.20 time: 0.309600 May 26 16:45:38.744293 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 251/497] 10.222.0.102 () {62 vars in 1323 bytes} [Thu May 26 16:45:38 2022] POST /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 26 16:45:38.752865 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-4aa9965d-e3ee-4ecd-8f64-e2e60bbaa354 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:38.753469 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-4aa9965d-e3ee-4ecd-8f64-e2e60bbaa354 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:38.759917 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4aa9965d-e3ee-4ecd-8f64-e2e60bbaa354 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:38.760497 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4aa9965d-e3ee-4ecd-8f64-e2e60bbaa354 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:38.763091 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4aa9965d-e3ee-4ecd-8f64-e2e60bbaa354 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:38.763091 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4aa9965d-e3ee-4ecd-8f64-e2e60bbaa354 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:38.795919 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-57381c9d-c2f7-40ba-ad29-dc64a5f21615 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:38.797090 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-57381c9d-c2f7-40ba-ad29-dc64a5f21615 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:38.800925 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=42 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:38.809913 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-57381c9d-c2f7-40ba-ad29-dc64a5f21615 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:38.810491 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-57381c9d-c2f7-40ba-ad29-dc64a5f21615 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:38.811384 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-57381c9d-c2f7-40ba-ad29-dc64a5f21615 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:38.811967 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-57381c9d-c2f7-40ba-ad29-dc64a5f21615 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:38.974768 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-4aa9965d-e3ee-4ecd-8f64-e2e60bbaa354 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:38.988914 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-4aa9965d-e3ee-4ecd-8f64-e2e60bbaa354 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:38.992076 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-4aa9965d-e3ee-4ecd-8f64-e2e60bbaa354 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:38.994238 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-4aa9965d-e3ee-4ecd-8f64-e2e60bbaa354 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1729 microversion: 2.20 time: 0.245243 May 26 16:45:38.995073 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 247/498] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:45:38 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1729 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:45:39.019224 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-57381c9d-c2f7-40ba-ad29-dc64a5f21615 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:39.028442 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-57381c9d-c2f7-40ba-ad29-dc64a5f21615 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1263 microversion: 2.1 time: 0.239713 May 26 16:45:39.029027 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 252/499] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:38 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1263 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:40.013274 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-dc33b4e2-2717-4bce-baf2-58af42d2bfcb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:40.013968 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-dc33b4e2-2717-4bce-baf2-58af42d2bfcb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:40.019907 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-dc33b4e2-2717-4bce-baf2-58af42d2bfcb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:40.020343 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-dc33b4e2-2717-4bce-baf2-58af42d2bfcb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:40.021133 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-dc33b4e2-2717-4bce-baf2-58af42d2bfcb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:40.021568 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-dc33b4e2-2717-4bce-baf2-58af42d2bfcb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:40.054456 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ed7be9c6-f0af-4983-81ea-c615e8a18804 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:40.055626 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ed7be9c6-f0af-4983-81ea-c615e8a18804 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:40.063641 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ed7be9c6-f0af-4983-81ea-c615e8a18804 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:40.064302 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ed7be9c6-f0af-4983-81ea-c615e8a18804 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:40.065728 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ed7be9c6-f0af-4983-81ea-c615e8a18804 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:40.066210 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ed7be9c6-f0af-4983-81ea-c615e8a18804 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:40.240910 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-dc33b4e2-2717-4bce-baf2-58af42d2bfcb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:40.249365 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-dc33b4e2-2717-4bce-baf2-58af42d2bfcb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:40.250862 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-dc33b4e2-2717-4bce-baf2-58af42d2bfcb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:40.252017 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-dc33b4e2-2717-4bce-baf2-58af42d2bfcb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1729 microversion: 2.20 time: 0.242641 May 26 16:45:40.252611 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 248/500] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:45:40 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1729 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:45:40.266998 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ed7be9c6-f0af-4983-81ea-c615e8a18804 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:40.277957 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ed7be9c6-f0af-4983-81ea-c615e8a18804 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1263 microversion: 2.1 time: 0.228014 May 26 16:45:40.278542 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 253/501] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:40 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1263 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:45:41.271765 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-3442c2ee-9a5f-439a-aea2-75a02101c1fa tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:41.272546 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-3442c2ee-9a5f-439a-aea2-75a02101c1fa tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:41.278847 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3442c2ee-9a5f-439a-aea2-75a02101c1fa tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:41.279300 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3442c2ee-9a5f-439a-aea2-75a02101c1fa tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:41.280089 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3442c2ee-9a5f-439a-aea2-75a02101c1fa tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:41.280566 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3442c2ee-9a5f-439a-aea2-75a02101c1fa tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:41.299259 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9a5e34ae-576d-48f9-87ec-69968eba9cae tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:41.300435 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9a5e34ae-576d-48f9-87ec-69968eba9cae tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:41.313323 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9a5e34ae-576d-48f9-87ec-69968eba9cae tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:41.314131 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9a5e34ae-576d-48f9-87ec-69968eba9cae tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:41.315571 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9a5e34ae-576d-48f9-87ec-69968eba9cae tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:41.316407 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9a5e34ae-576d-48f9-87ec-69968eba9cae tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:41.532311 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-3442c2ee-9a5f-439a-aea2-75a02101c1fa tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:41.545576 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-3442c2ee-9a5f-439a-aea2-75a02101c1fa tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:41.551774 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-3442c2ee-9a5f-439a-aea2-75a02101c1fa tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:41.553113 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9a5e34ae-576d-48f9-87ec-69968eba9cae tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:41.554423 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-3442c2ee-9a5f-439a-aea2-75a02101c1fa tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1729 microversion: 2.20 time: 0.286221 May 26 16:45:41.555283 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 249/502] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:45:41 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1729 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:45:41.562790 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9a5e34ae-576d-48f9-87ec-69968eba9cae tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1263 microversion: 2.1 time: 0.270775 May 26 16:45:41.563647 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 254/503] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:41 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1263 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:41.842433 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-ec140dbd-0ce2-4298-b957-499d0c2dc145 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a6d062d-8da6-4044-85aa-50c4b68bc67d"}} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:45:41.843498 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-ec140dbd-0ce2-4298-b957-499d0c2dc145 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:41.849499 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ec140dbd-0ce2-4298-b957-499d0c2dc145 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:41.849955 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ec140dbd-0ce2-4298-b957-499d0c2dc145 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:41.850720 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ec140dbd-0ce2-4298-b957-499d0c2dc145 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:41.851161 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ec140dbd-0ce2-4298-b957-499d0c2dc145 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:42.176164 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-ec140dbd-0ce2-4298-b957-499d0c2dc145 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "POST /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.336990 May 26 16:45:42.179508 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 250/504] 10.222.0.102 () {60 vars in 1327 bytes} [Thu May 26 16:45:41 2022] POST /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29/os-volume_attachments => generated 194 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:45:42.577640 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d166b514-9330-4f85-be14-b7b8e1f0d644 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:42.578204 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d166b514-9330-4f85-be14-b7b8e1f0d644 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:42.579914 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-1fe165cd-d6bf-4be6-8f12-2333f54a41f2 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:42.580658 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-1fe165cd-d6bf-4be6-8f12-2333f54a41f2 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:42.586175 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d166b514-9330-4f85-be14-b7b8e1f0d644 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:42.586623 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d166b514-9330-4f85-be14-b7b8e1f0d644 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:42.587405 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d166b514-9330-4f85-be14-b7b8e1f0d644 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:42.587840 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d166b514-9330-4f85-be14-b7b8e1f0d644 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:42.588491 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1fe165cd-d6bf-4be6-8f12-2333f54a41f2 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:42.588945 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1fe165cd-d6bf-4be6-8f12-2333f54a41f2 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:42.589730 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1fe165cd-d6bf-4be6-8f12-2333f54a41f2 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:42.590165 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1fe165cd-d6bf-4be6-8f12-2333f54a41f2 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:42.901111 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-1fe165cd-d6bf-4be6-8f12-2333f54a41f2 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:42.911242 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-1fe165cd-d6bf-4be6-8f12-2333f54a41f2 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1263 microversion: 2.1 time: 0.335399 May 26 16:45:42.912096 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 251/505] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:42 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1263 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:45:42.918205 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d166b514-9330-4f85-be14-b7b8e1f0d644 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:42.931998 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d166b514-9330-4f85-be14-b7b8e1f0d644 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:42.933737 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d166b514-9330-4f85-be14-b7b8e1f0d644 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:42.934940 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d166b514-9330-4f85-be14-b7b8e1f0d644 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1729 microversion: 2.20 time: 0.361605 May 26 16:45:42.935488 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 255/506] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:45:42 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1729 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:45:43.936481 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-ebf428a0-1f85-4409-a336-1ae0c7e16d74 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:43.937087 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-ebf428a0-1f85-4409-a336-1ae0c7e16d74 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:43.939534 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell0:SELECT=2 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:43.940183 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell0:SELECT=6 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:43.947244 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ebf428a0-1f85-4409-a336-1ae0c7e16d74 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:43.947701 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ebf428a0-1f85-4409-a336-1ae0c7e16d74 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:43.948520 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ebf428a0-1f85-4409-a336-1ae0c7e16d74 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:43.948961 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ebf428a0-1f85-4409-a336-1ae0c7e16d74 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:43.954712 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a1750ee2-7099-419e-9a65-48ded1930143 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:43.955410 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a1750ee2-7099-419e-9a65-48ded1930143 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:43.957279 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:43.964423 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a1750ee2-7099-419e-9a65-48ded1930143 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:43.964880 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a1750ee2-7099-419e-9a65-48ded1930143 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:43.965667 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a1750ee2-7099-419e-9a65-48ded1930143 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:43.966103 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a1750ee2-7099-419e-9a65-48ded1930143 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:44.130130 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:44.166359 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-ebf428a0-1f85-4409-a336-1ae0c7e16d74 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:44.174201 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-ebf428a0-1f85-4409-a336-1ae0c7e16d74 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1263 microversion: 2.1 time: 0.241597 May 26 16:45:44.174810 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 252/507] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:43 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1263 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:44.181489 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a1750ee2-7099-419e-9a65-48ded1930143 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:44.197968 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a1750ee2-7099-419e-9a65-48ded1930143 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:44.199513 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a1750ee2-7099-419e-9a65-48ded1930143 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:44.200874 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a1750ee2-7099-419e-9a65-48ded1930143 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1729 microversion: 2.20 time: 0.250126 May 26 16:45:44.202000 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 256/508] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:45:43 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1729 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:45:45.170109 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-758bea84-886a-44b3-a3d1-efd14b974e3c req-820b0a36-d670-436d-9111-c986a185c3b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "898074a4-2c24-403a-bdd9-e9809f6375fd", "name": "network-vif-plugged", "status": "completed", "tag": "a5a3472f-1b24-4c5b-ada9-48c5e198da12"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:45:45.179697 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-758bea84-886a-44b3-a3d1-efd14b974e3c req-820b0a36-d670-436d-9111-c986a185c3b6 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:45.180234 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-758bea84-886a-44b3-a3d1-efd14b974e3c req-820b0a36-d670-436d-9111-c986a185c3b6 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:45.191095 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a2fa0f92-343b-4fd9-917b-95c021945420 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:45.191962 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a2fa0f92-343b-4fd9-917b-95c021945420 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:45.193172 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-758bea84-886a-44b3-a3d1-efd14b974e3c req-820b0a36-d670-436d-9111-c986a185c3b6 service nova] Creating event network-vif-plugged:a5a3472f-1b24-4c5b-ada9-48c5e198da12 for instance 898074a4-2c24-403a-bdd9-e9809f6375fd on hv-cinder-83607 May 26 16:45:45.198700 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a2fa0f92-343b-4fd9-917b-95c021945420 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:45.199022 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-758bea84-886a-44b3-a3d1-efd14b974e3c req-820b0a36-d670-436d-9111-c986a185c3b6 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032431 May 26 16:45:45.199200 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a2fa0f92-343b-4fd9-917b-95c021945420 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:45.199922 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a2fa0f92-343b-4fd9-917b-95c021945420 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:45.200242 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 253/509] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:45:45.200469 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a2fa0f92-343b-4fd9-917b-95c021945420 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:45.203374 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:45.227474 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-fc1ec9bf-5ed4-4481-90fa-0a236f708211 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:45.228523 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-fc1ec9bf-5ed4-4481-90fa-0a236f708211 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:45.236652 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fc1ec9bf-5ed4-4481-90fa-0a236f708211 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:45.237109 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fc1ec9bf-5ed4-4481-90fa-0a236f708211 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:45.238300 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fc1ec9bf-5ed4-4481-90fa-0a236f708211 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:45.238751 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fc1ec9bf-5ed4-4481-90fa-0a236f708211 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:45.437599 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a2fa0f92-343b-4fd9-917b-95c021945420 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:45.448619 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a2fa0f92-343b-4fd9-917b-95c021945420 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1263 microversion: 2.1 time: 0.261298 May 26 16:45:45.449434 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 257/510] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:45 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1263 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:45:45.450793 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-fc1ec9bf-5ed4-4481-90fa-0a236f708211 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:45.462658 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-fc1ec9bf-5ed4-4481-90fa-0a236f708211 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:45.464489 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-fc1ec9bf-5ed4-4481-90fa-0a236f708211 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:45.465953 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-fc1ec9bf-5ed4-4481-90fa-0a236f708211 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1729 microversion: 2.20 time: 0.243530 May 26 16:45:45.485097 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 254/511] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:45:45 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1729 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:45:46.466127 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0383e589-6d49-4a0d-8abc-c085b87405d4 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:46.466806 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0383e589-6d49-4a0d-8abc-c085b87405d4 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:46.473487 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0383e589-6d49-4a0d-8abc-c085b87405d4 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:46.473993 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0383e589-6d49-4a0d-8abc-c085b87405d4 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:46.474766 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0383e589-6d49-4a0d-8abc-c085b87405d4 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:46.475691 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0383e589-6d49-4a0d-8abc-c085b87405d4 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:46.492330 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-9fc8dc32-8d03-4fad-aa44-e2e54218fab2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:46.495092 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-9fc8dc32-8d03-4fad-aa44-e2e54218fab2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:46.505793 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9fc8dc32-8d03-4fad-aa44-e2e54218fab2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:46.507015 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9fc8dc32-8d03-4fad-aa44-e2e54218fab2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:46.509042 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9fc8dc32-8d03-4fad-aa44-e2e54218fab2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:46.510068 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9fc8dc32-8d03-4fad-aa44-e2e54218fab2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:46.727057 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0383e589-6d49-4a0d-8abc-c085b87405d4 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:46.731242 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-9fc8dc32-8d03-4fad-aa44-e2e54218fab2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:46.734996 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0383e589-6d49-4a0d-8abc-c085b87405d4 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1263 microversion: 2.1 time: 0.272531 May 26 16:45:46.735500 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 258/512] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:46 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1263 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:46.740306 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e5a01a6e-4367-4b64-9827-6bed23ee22b9 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:46.741450 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-9fc8dc32-8d03-4fad-aa44-e2e54218fab2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:46.741857 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e5a01a6e-4367-4b64-9827-6bed23ee22b9 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:46.742732 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-9fc8dc32-8d03-4fad-aa44-e2e54218fab2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:46.743990 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-9fc8dc32-8d03-4fad-aa44-e2e54218fab2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1729 microversion: 2.20 time: 0.259236 May 26 16:45:46.744593 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 255/513] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:45:46 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1729 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:45:46.749455 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e5a01a6e-4367-4b64-9827-6bed23ee22b9 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:46.749880 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e5a01a6e-4367-4b64-9827-6bed23ee22b9 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:46.750653 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e5a01a6e-4367-4b64-9827-6bed23ee22b9 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:46.751077 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e5a01a6e-4367-4b64-9827-6bed23ee22b9 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:46.883815 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e5a01a6e-4367-4b64-9827-6bed23ee22b9 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:46.892145 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e5a01a6e-4367-4b64-9827-6bed23ee22b9 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1598 microversion: 2.1 time: 0.155410 May 26 16:45:46.892993 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 259/514] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:46 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:47.751993 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-bdbd768d-8f19-45c0-8198-89cfed8679ec tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:47.752626 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-bdbd768d-8f19-45c0-8198-89cfed8679ec tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:47.760222 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bdbd768d-8f19-45c0-8198-89cfed8679ec tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:47.760711 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bdbd768d-8f19-45c0-8198-89cfed8679ec tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:47.761489 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bdbd768d-8f19-45c0-8198-89cfed8679ec tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:47.761924 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bdbd768d-8f19-45c0-8198-89cfed8679ec tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:47.762859 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-cadc2ae8-49af-4dd8-9ea4-b403208424d3 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:47.763996 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-cadc2ae8-49af-4dd8-9ea4-b403208424d3 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:47.770697 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cadc2ae8-49af-4dd8-9ea4-b403208424d3 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:47.771151 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cadc2ae8-49af-4dd8-9ea4-b403208424d3 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:47.771970 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cadc2ae8-49af-4dd8-9ea4-b403208424d3 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:47.772618 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cadc2ae8-49af-4dd8-9ea4-b403208424d3 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:47.973514 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-bdbd768d-8f19-45c0-8198-89cfed8679ec tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:47.981642 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-bdbd768d-8f19-45c0-8198-89cfed8679ec tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1263 microversion: 2.1 time: 0.233531 May 26 16:45:47.982235 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 256/515] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:47 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1263 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:47.985561 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-cadc2ae8-49af-4dd8-9ea4-b403208424d3 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:47.994624 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-cadc2ae8-49af-4dd8-9ea4-b403208424d3 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:47.996206 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-cadc2ae8-49af-4dd8-9ea4-b403208424d3 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:47.997571 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-cadc2ae8-49af-4dd8-9ea4-b403208424d3 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1729 microversion: 2.20 time: 0.238570 May 26 16:45:47.998238 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 260/516] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:45:47 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1729 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:45:48.753312 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-3e42e5da-6ad3-4aeb-b0df-09ed2798ce82 req-487e5bdd-5ca8-4c8d-8d47-53371bf0acf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b7b9106-8559-47d1-93c5-3549d90ee4f8", "tag": "cca18761-4fc8-4413-bdd9-ee704f060a72"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:45:48.763355 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-3e42e5da-6ad3-4aeb-b0df-09ed2798ce82 req-487e5bdd-5ca8-4c8d-8d47-53371bf0acf3 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:48.763797 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-3e42e5da-6ad3-4aeb-b0df-09ed2798ce82 req-487e5bdd-5ca8-4c8d-8d47-53371bf0acf3 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:48.778883 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-3e42e5da-6ad3-4aeb-b0df-09ed2798ce82 req-487e5bdd-5ca8-4c8d-8d47-53371bf0acf3 service nova] Creating event network-changed:cca18761-4fc8-4413-bdd9-ee704f060a72 for instance 7b7b9106-8559-47d1-93c5-3549d90ee4f8 on hv-cinder-83607 May 26 16:45:48.785127 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-3e42e5da-6ad3-4aeb-b0df-09ed2798ce82 req-487e5bdd-5ca8-4c8d-8d47-53371bf0acf3 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035043 May 26 16:45:48.788635 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 257/517] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:45:49.002756 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-64393fcb-4afe-419c-a5a8-40e7c11c1899 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:49.004034 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-64393fcb-4afe-419c-a5a8-40e7c11c1899 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:49.015342 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-64393fcb-4afe-419c-a5a8-40e7c11c1899 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:49.016250 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-64393fcb-4afe-419c-a5a8-40e7c11c1899 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:49.017357 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-64393fcb-4afe-419c-a5a8-40e7c11c1899 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:49.017733 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-c63f96d6-a1f3-4fa5-bb87-4de48298ece4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:49.018120 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-64393fcb-4afe-419c-a5a8-40e7c11c1899 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:49.018726 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-c63f96d6-a1f3-4fa5-bb87-4de48298ece4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:49.026151 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c63f96d6-a1f3-4fa5-bb87-4de48298ece4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:49.026966 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c63f96d6-a1f3-4fa5-bb87-4de48298ece4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:49.028443 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c63f96d6-a1f3-4fa5-bb87-4de48298ece4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:49.029121 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c63f96d6-a1f3-4fa5-bb87-4de48298ece4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:49.046075 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:49.340612 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-64393fcb-4afe-419c-a5a8-40e7c11c1899 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:49.348908 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-c63f96d6-a1f3-4fa5-bb87-4de48298ece4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:49.353171 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-64393fcb-4afe-419c-a5a8-40e7c11c1899 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1448 microversion: 2.1 time: 0.356549 May 26 16:45:49.354306 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 261/518] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:48 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1448 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:49.368101 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-c63f96d6-a1f3-4fa5-bb87-4de48298ece4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:49.369933 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-c63f96d6-a1f3-4fa5-bb87-4de48298ece4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:49.371192 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-c63f96d6-a1f3-4fa5-bb87-4de48298ece4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1729 microversion: 2.20 time: 0.358509 May 26 16:45:49.371456 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a345b10e-fab1-4a98-bfd3-df0495cc2a81 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:49.371776 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 258/519] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:45:49 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1729 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:45:49.372672 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a345b10e-fab1-4a98-bfd3-df0495cc2a81 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:49.379785 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a345b10e-fab1-4a98-bfd3-df0495cc2a81 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:49.380664 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a345b10e-fab1-4a98-bfd3-df0495cc2a81 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:49.382162 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a345b10e-fab1-4a98-bfd3-df0495cc2a81 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:49.382813 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a345b10e-fab1-4a98-bfd3-df0495cc2a81 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:49.638522 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a345b10e-fab1-4a98-bfd3-df0495cc2a81 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:49.655403 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a345b10e-fab1-4a98-bfd3-df0495cc2a81 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1448 microversion: 2.1 time: 0.287957 May 26 16:45:49.656042 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 262/520] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:49 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1448 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:50.372737 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-82d79486-bb1b-4275-bb9f-78fd2aca646d tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-312083356"}} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:45:50.373296 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-82d79486-bb1b-4275-bb9f-78fd2aca646d tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:50.382336 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-82d79486-bb1b-4275-bb9f-78fd2aca646d tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:50.382869 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-82d79486-bb1b-4275-bb9f-78fd2aca646d tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:50.383762 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-82d79486-bb1b-4275-bb9f-78fd2aca646d tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:50.384199 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-82d79486-bb1b-4275-bb9f-78fd2aca646d tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:50.391969 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f3f33350-dc07-4ed4-8392-f47cdde8b26e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:50.393491 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f3f33350-dc07-4ed4-8392-f47cdde8b26e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:50.401724 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f3f33350-dc07-4ed4-8392-f47cdde8b26e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:50.402438 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f3f33350-dc07-4ed4-8392-f47cdde8b26e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:50.403552 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f3f33350-dc07-4ed4-8392-f47cdde8b26e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:50.404165 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f3f33350-dc07-4ed4-8392-f47cdde8b26e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:50.692097 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.network.security_group_api [None req-82d79486-bb1b-4275-bb9f-78fd2aca646d tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Adding security group 37c75c9d-f08f-4004-ba1d-4128ef73aa3f to port cca18761-4fc8-4413-bdd9-ee704f060a72 May 26 16:45:50.768478 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f3f33350-dc07-4ed4-8392-f47cdde8b26e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:50.776703 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f3f33350-dc07-4ed4-8392-f47cdde8b26e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:50.778216 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f3f33350-dc07-4ed4-8392-f47cdde8b26e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:50.779379 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f3f33350-dc07-4ed4-8392-f47cdde8b26e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1729 microversion: 2.20 time: 0.393321 May 26 16:45:50.779939 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 263/521] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:45:50 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1729 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:45:51.691612 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-82d79486-bb1b-4275-bb9f-78fd2aca646d tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "POST /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8/action" status: 202 len: 0 microversion: 2.1 time: 1.321893 May 26 16:45:51.693126 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 259/522] 10.222.0.102 () {60 vars in 1282 bytes} [Thu May 26 16:45:50 2022] POST /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8/action => generated 0 bytes in 1325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 16:45:51.701758 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f50415c1-5963-46ae-b675-c467c1d2a151 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:51.705516 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f50415c1-5963-46ae-b675-c467c1d2a151 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:51.710332 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-bd3f5b2a-f3e5-4766-93f1-6aa457ac2287 req-a93a984f-2745-4ca0-9549-7d20c7c5ebea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b7b9106-8559-47d1-93c5-3549d90ee4f8", "tag": "cca18761-4fc8-4413-bdd9-ee704f060a72"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:45:51.714222 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f50415c1-5963-46ae-b675-c467c1d2a151 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:51.716138 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f50415c1-5963-46ae-b675-c467c1d2a151 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:51.717296 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f50415c1-5963-46ae-b675-c467c1d2a151 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:51.717981 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f50415c1-5963-46ae-b675-c467c1d2a151 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:51.732792 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-bd3f5b2a-f3e5-4766-93f1-6aa457ac2287 req-a93a984f-2745-4ca0-9549-7d20c7c5ebea service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:51.733241 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-bd3f5b2a-f3e5-4766-93f1-6aa457ac2287 req-a93a984f-2745-4ca0-9549-7d20c7c5ebea service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:51.756092 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-bd3f5b2a-f3e5-4766-93f1-6aa457ac2287 req-a93a984f-2745-4ca0-9549-7d20c7c5ebea service nova] Creating event network-changed:cca18761-4fc8-4413-bdd9-ee704f060a72 for instance 7b7b9106-8559-47d1-93c5-3549d90ee4f8 on hv-cinder-83607 May 26 16:45:51.765209 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-bd3f5b2a-f3e5-4766-93f1-6aa457ac2287 req-a93a984f-2745-4ca0-9549-7d20c7c5ebea service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058680 May 26 16:45:51.765833 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 260/523] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:45:51.798893 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-04b5afd0-a88f-495d-a330-13c0f9cbe389 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:51.800246 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-04b5afd0-a88f-495d-a330-13c0f9cbe389 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:51.809128 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-04b5afd0-a88f-495d-a330-13c0f9cbe389 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:51.809803 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-04b5afd0-a88f-495d-a330-13c0f9cbe389 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:51.810768 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-04b5afd0-a88f-495d-a330-13c0f9cbe389 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:51.811368 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-04b5afd0-a88f-495d-a330-13c0f9cbe389 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:52.113118 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f50415c1-5963-46ae-b675-c467c1d2a151 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:52.127279 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f50415c1-5963-46ae-b675-c467c1d2a151 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1763 microversion: 2.1 time: 0.429180 May 26 16:45:52.140477 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 264/524] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:51 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1763 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:52.172218 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-04b5afd0-a88f-495d-a330-13c0f9cbe389 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:52.191718 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-04b5afd0-a88f-495d-a330-13c0f9cbe389 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:52.194022 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-04b5afd0-a88f-495d-a330-13c0f9cbe389 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:52.195879 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-04b5afd0-a88f-495d-a330-13c0f9cbe389 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1729 microversion: 2.20 time: 0.401472 May 26 16:45:52.197096 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 261/525] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:45:51 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1729 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:45:53.217106 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-64b2b34c-c89c-4f30-8af5-fc227080388a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:53.217658 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-64b2b34c-c89c-4f30-8af5-fc227080388a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:53.224490 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-64b2b34c-c89c-4f30-8af5-fc227080388a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:53.224937 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-64b2b34c-c89c-4f30-8af5-fc227080388a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:53.225708 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-64b2b34c-c89c-4f30-8af5-fc227080388a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:53.226137 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-64b2b34c-c89c-4f30-8af5-fc227080388a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:53.369912 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-64b2b34c-c89c-4f30-8af5-fc227080388a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:53.379724 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-64b2b34c-c89c-4f30-8af5-fc227080388a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:53.381952 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-64b2b34c-c89c-4f30-8af5-fc227080388a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:53.383154 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-64b2b34c-c89c-4f30-8af5-fc227080388a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1729 microversion: 2.20 time: 0.171320 May 26 16:45:53.383725 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 265/526] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:45:53 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:45:53.780969 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-1fe319a7-038f-4034-af45-76efe3c8b7b4 req-24018e15-79bf-4945-886b-c29e1f673ecf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "898074a4-2c24-403a-bdd9-e9809f6375fd", "tag": "a5a3472f-1b24-4c5b-ada9-48c5e198da12"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:45:53.789767 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-1fe319a7-038f-4034-af45-76efe3c8b7b4 req-24018e15-79bf-4945-886b-c29e1f673ecf service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:53.790213 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-1fe319a7-038f-4034-af45-76efe3c8b7b4 req-24018e15-79bf-4945-886b-c29e1f673ecf service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:53.800943 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-1fe319a7-038f-4034-af45-76efe3c8b7b4 req-24018e15-79bf-4945-886b-c29e1f673ecf service nova] Creating event network-changed:a5a3472f-1b24-4c5b-ada9-48c5e198da12 for instance 898074a4-2c24-403a-bdd9-e9809f6375fd on hv-cinder-83607 May 26 16:45:53.806887 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-1fe319a7-038f-4034-af45-76efe3c8b7b4 req-24018e15-79bf-4945-886b-c29e1f673ecf service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029533 May 26 16:45:53.807472 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 262/527] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:45:54.401893 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7c8c9433-76b1-4a3c-ac28-610736538fa5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:54.402648 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-7c8c9433-76b1-4a3c-ac28-610736538fa5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:54.410963 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7c8c9433-76b1-4a3c-ac28-610736538fa5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:54.411408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7c8c9433-76b1-4a3c-ac28-610736538fa5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:54.412276 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7c8c9433-76b1-4a3c-ac28-610736538fa5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:54.413277 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7c8c9433-76b1-4a3c-ac28-610736538fa5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:54.567228 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7c8c9433-76b1-4a3c-ac28-610736538fa5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:54.580386 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7c8c9433-76b1-4a3c-ac28-610736538fa5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:54.581917 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7c8c9433-76b1-4a3c-ac28-610736538fa5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:54.583371 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7c8c9433-76b1-4a3c-ac28-610736538fa5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1729 microversion: 2.20 time: 0.185396 May 26 16:45:54.584003 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 266/528] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:45:54 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1729 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:45:55.151048 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-5f935a2f-2fdc-4ae1-a8d5-49b66a727280 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:45:55.157577 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-5f935a2f-2fdc-4ae1-a8d5-49b66a727280 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:55.158095 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-5f935a2f-2fdc-4ae1-a8d5-49b66a727280 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:55.218230 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-5f935a2f-2fdc-4ae1-a8d5-49b66a727280 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Going to try to stop instance {{(pid=124267) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 26 16:45:55.268218 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-5f935a2f-2fdc-4ae1-a8d5-49b66a727280 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "POST /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29/action" status: 202 len: 0 microversion: 2.1 time: 0.122191 May 26 16:45:55.268872 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 263/529] 10.222.0.102 () {60 vars in 1282 bytes} [Thu May 26 16:45:55 2022] POST /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 16:45:55.277174 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f5221b47-4656-4451-b5e0-7ac12446233e tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:55.277880 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f5221b47-4656-4451-b5e0-7ac12446233e tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:55.284203 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f5221b47-4656-4451-b5e0-7ac12446233e tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:55.284835 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f5221b47-4656-4451-b5e0-7ac12446233e tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:55.285662 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f5221b47-4656-4451-b5e0-7ac12446233e tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:55.286147 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f5221b47-4656-4451-b5e0-7ac12446233e tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:55.415053 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f5221b47-4656-4451-b5e0-7ac12446233e tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:55.422994 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f5221b47-4656-4451-b5e0-7ac12446233e tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1727 microversion: 2.1 time: 0.149803 May 26 16:45:55.423537 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 267/530] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:55 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:55.603398 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-8672059b-8ab1-44cb-a453-ae4d2e34af20 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:55.604100 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-8672059b-8ab1-44cb-a453-ae4d2e34af20 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:55.610404 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8672059b-8ab1-44cb-a453-ae4d2e34af20 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:55.610862 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8672059b-8ab1-44cb-a453-ae4d2e34af20 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:55.611633 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8672059b-8ab1-44cb-a453-ae4d2e34af20 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:55.612076 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8672059b-8ab1-44cb-a453-ae4d2e34af20 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:55.742362 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-8672059b-8ab1-44cb-a453-ae4d2e34af20 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:55.750408 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-8672059b-8ab1-44cb-a453-ae4d2e34af20 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:55.751935 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-8672059b-8ab1-44cb-a453-ae4d2e34af20 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:55.753137 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-8672059b-8ab1-44cb-a453-ae4d2e34af20 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1729 microversion: 2.20 time: 0.154611 May 26 16:45:55.753711 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 264/531] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:45:55 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:45:56.441657 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d20f80fd-a49d-42a1-9fe5-49bc985680dd tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:56.442194 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d20f80fd-a49d-42a1-9fe5-49bc985680dd tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:56.450306 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d20f80fd-a49d-42a1-9fe5-49bc985680dd tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:56.450751 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d20f80fd-a49d-42a1-9fe5-49bc985680dd tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:56.451534 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d20f80fd-a49d-42a1-9fe5-49bc985680dd tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:56.451968 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d20f80fd-a49d-42a1-9fe5-49bc985680dd tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:56.587298 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d20f80fd-a49d-42a1-9fe5-49bc985680dd tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:56.596160 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d20f80fd-a49d-42a1-9fe5-49bc985680dd tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1727 microversion: 2.1 time: 0.158604 May 26 16:45:56.596764 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 268/532] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:56 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:56.771155 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-f66d2074-ee09-4190-9324-8a0b3b58eb91 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:56.771780 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-f66d2074-ee09-4190-9324-8a0b3b58eb91 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:56.778323 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f66d2074-ee09-4190-9324-8a0b3b58eb91 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:56.778767 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f66d2074-ee09-4190-9324-8a0b3b58eb91 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:56.779530 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f66d2074-ee09-4190-9324-8a0b3b58eb91 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:56.780020 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f66d2074-ee09-4190-9324-8a0b3b58eb91 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:56.907100 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-f66d2074-ee09-4190-9324-8a0b3b58eb91 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:56.916131 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-f66d2074-ee09-4190-9324-8a0b3b58eb91 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:56.917724 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-f66d2074-ee09-4190-9324-8a0b3b58eb91 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:56.918885 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-f66d2074-ee09-4190-9324-8a0b3b58eb91 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1729 microversion: 2.20 time: 0.151681 May 26 16:45:56.919453 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 265/533] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:45:56 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:45:57.614129 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-47ccb911-55ad-4554-b444-6f091a7ffff7 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:57.614681 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-47ccb911-55ad-4554-b444-6f091a7ffff7 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:57.621655 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-47ccb911-55ad-4554-b444-6f091a7ffff7 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:57.622117 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-47ccb911-55ad-4554-b444-6f091a7ffff7 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:57.622896 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-47ccb911-55ad-4554-b444-6f091a7ffff7 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:57.623338 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-47ccb911-55ad-4554-b444-6f091a7ffff7 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:57.759705 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-47ccb911-55ad-4554-b444-6f091a7ffff7 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:57.767634 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-47ccb911-55ad-4554-b444-6f091a7ffff7 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1727 microversion: 2.1 time: 0.157547 May 26 16:45:57.768221 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 269/534] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:57 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:57.937257 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-bf4649ca-c64d-40bf-9096-5c6d5ca82188 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:57.937840 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-bf4649ca-c64d-40bf-9096-5c6d5ca82188 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:57.945117 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bf4649ca-c64d-40bf-9096-5c6d5ca82188 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:57.945576 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bf4649ca-c64d-40bf-9096-5c6d5ca82188 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:57.946352 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bf4649ca-c64d-40bf-9096-5c6d5ca82188 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:57.946798 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bf4649ca-c64d-40bf-9096-5c6d5ca82188 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:58.075094 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-bf4649ca-c64d-40bf-9096-5c6d5ca82188 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:58.083232 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-bf4649ca-c64d-40bf-9096-5c6d5ca82188 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:58.084828 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-bf4649ca-c64d-40bf-9096-5c6d5ca82188 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:58.085989 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-bf4649ca-c64d-40bf-9096-5c6d5ca82188 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1729 microversion: 2.20 time: 0.152753 May 26 16:45:58.086878 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 266/535] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:45:57 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:45:58.785333 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-5f97516a-853d-4380-8d43-698d819150ab tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:58.785949 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-5f97516a-853d-4380-8d43-698d819150ab tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:58.792531 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5f97516a-853d-4380-8d43-698d819150ab tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:58.792989 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5f97516a-853d-4380-8d43-698d819150ab tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:58.793759 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5f97516a-853d-4380-8d43-698d819150ab tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:58.794198 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5f97516a-853d-4380-8d43-698d819150ab tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:58.939787 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-5f97516a-853d-4380-8d43-698d819150ab tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:58.948578 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-5f97516a-853d-4380-8d43-698d819150ab tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1727 microversion: 2.1 time: 0.167000 May 26 16:45:58.949082 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 270/536] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:58 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:59.105386 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-82b5bb32-1a72-47ba-a05b-0f36bf25fea9 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:59.106030 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-82b5bb32-1a72-47ba-a05b-0f36bf25fea9 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:59.112742 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-82b5bb32-1a72-47ba-a05b-0f36bf25fea9 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:59.113113 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-82b5bb32-1a72-47ba-a05b-0f36bf25fea9 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:59.113877 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-82b5bb32-1a72-47ba-a05b-0f36bf25fea9 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:59.114341 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-82b5bb32-1a72-47ba-a05b-0f36bf25fea9 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:59.245816 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-82b5bb32-1a72-47ba-a05b-0f36bf25fea9 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:59.254979 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-82b5bb32-1a72-47ba-a05b-0f36bf25fea9 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:59.257290 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-82b5bb32-1a72-47ba-a05b-0f36bf25fea9 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:45:59.259118 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-82b5bb32-1a72-47ba-a05b-0f36bf25fea9 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1729 microversion: 2.20 time: 0.157455 May 26 16:45:59.259821 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 267/537] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:45:59 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:45:59.966309 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-5c3bc08c-9d43-486e-a404-9fd29fb69643 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:59.966992 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-5c3bc08c-9d43-486e-a404-9fd29fb69643 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:45:59.973437 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5c3bc08c-9d43-486e-a404-9fd29fb69643 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:59.973888 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5c3bc08c-9d43-486e-a404-9fd29fb69643 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:45:59.974684 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5c3bc08c-9d43-486e-a404-9fd29fb69643 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:45:59.975121 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5c3bc08c-9d43-486e-a404-9fd29fb69643 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:00.103634 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-5c3bc08c-9d43-486e-a404-9fd29fb69643 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:00.112038 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-5c3bc08c-9d43-486e-a404-9fd29fb69643 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1727 microversion: 2.1 time: 0.149504 May 26 16:46:00.112588 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 271/538] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:45:59 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:46:00.278821 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-50e88854-b94b-4e82-93c1-b4da61a5a97c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:00.279419 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-50e88854-b94b-4e82-93c1-b4da61a5a97c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:00.286065 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-50e88854-b94b-4e82-93c1-b4da61a5a97c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:00.286509 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-50e88854-b94b-4e82-93c1-b4da61a5a97c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:00.287930 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-50e88854-b94b-4e82-93c1-b4da61a5a97c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:00.288362 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-50e88854-b94b-4e82-93c1-b4da61a5a97c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:00.428646 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-50e88854-b94b-4e82-93c1-b4da61a5a97c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:00.437572 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-50e88854-b94b-4e82-93c1-b4da61a5a97c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:00.439091 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-50e88854-b94b-4e82-93c1-b4da61a5a97c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:00.440294 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-50e88854-b94b-4e82-93c1-b4da61a5a97c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1729 microversion: 2.20 time: 0.165611 May 26 16:46:00.440896 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 268/539] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:00 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:01.128782 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-848161a5-18e1-4b69-ab46-e10e5e6ba5a2 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:01.129401 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-848161a5-18e1-4b69-ab46-e10e5e6ba5a2 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:01.135864 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-848161a5-18e1-4b69-ab46-e10e5e6ba5a2 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:01.136316 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-848161a5-18e1-4b69-ab46-e10e5e6ba5a2 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:01.137110 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-848161a5-18e1-4b69-ab46-e10e5e6ba5a2 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:01.137546 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-848161a5-18e1-4b69-ab46-e10e5e6ba5a2 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:01.375014 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-848161a5-18e1-4b69-ab46-e10e5e6ba5a2 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:01.383612 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-848161a5-18e1-4b69-ab46-e10e5e6ba5a2 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1727 microversion: 2.1 time: 0.258708 May 26 16:46:01.384123 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 272/540] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:46:01 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1727 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:46:01.459843 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-d1e6f270-f2c9-4841-9a80-2977dd734d40 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:01.460482 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-d1e6f270-f2c9-4841-9a80-2977dd734d40 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:01.466924 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d1e6f270-f2c9-4841-9a80-2977dd734d40 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:01.467369 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d1e6f270-f2c9-4841-9a80-2977dd734d40 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:01.468133 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d1e6f270-f2c9-4841-9a80-2977dd734d40 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:01.468615 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d1e6f270-f2c9-4841-9a80-2977dd734d40 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:01.660524 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-d1e6f270-f2c9-4841-9a80-2977dd734d40 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:01.668787 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-d1e6f270-f2c9-4841-9a80-2977dd734d40 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:01.670275 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-d1e6f270-f2c9-4841-9a80-2977dd734d40 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:01.671437 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-d1e6f270-f2c9-4841-9a80-2977dd734d40 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1729 microversion: 2.20 time: 0.216104 May 26 16:46:01.672214 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 269/541] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:01 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1729 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:02.401296 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-087f7c1d-7155-41f3-9b05-abf285d690da tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:02.401933 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-087f7c1d-7155-41f3-9b05-abf285d690da tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:02.408671 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-087f7c1d-7155-41f3-9b05-abf285d690da tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:02.409184 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-087f7c1d-7155-41f3-9b05-abf285d690da tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:02.409955 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-087f7c1d-7155-41f3-9b05-abf285d690da tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:02.410398 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-087f7c1d-7155-41f3-9b05-abf285d690da tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:02.545086 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-087f7c1d-7155-41f3-9b05-abf285d690da tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:02.547266 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=100 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:02.554587 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-087f7c1d-7155-41f3-9b05-abf285d690da tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1727 microversion: 2.1 time: 0.157145 May 26 16:46:02.555168 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 273/542] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:46:02 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:46:02.689179 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-c442387e-ad26-4bc6-9885-88a59ddbea6e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:02.689777 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-c442387e-ad26-4bc6-9885-88a59ddbea6e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:02.697149 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c442387e-ad26-4bc6-9885-88a59ddbea6e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:02.697591 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c442387e-ad26-4bc6-9885-88a59ddbea6e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:02.698346 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c442387e-ad26-4bc6-9885-88a59ddbea6e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:02.698776 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c442387e-ad26-4bc6-9885-88a59ddbea6e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:02.828347 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-c442387e-ad26-4bc6-9885-88a59ddbea6e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:02.837107 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-c442387e-ad26-4bc6-9885-88a59ddbea6e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:02.838657 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-c442387e-ad26-4bc6-9885-88a59ddbea6e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:02.839827 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-c442387e-ad26-4bc6-9885-88a59ddbea6e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1750 microversion: 2.20 time: 0.154651 May 26 16:46:02.840404 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 270/543] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:02 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1750 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:03.572155 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a0b958e8-b068-4836-a36d-a9c39f28926c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:03.572795 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a0b958e8-b068-4836-a36d-a9c39f28926c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:03.579705 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a0b958e8-b068-4836-a36d-a9c39f28926c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:03.580157 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a0b958e8-b068-4836-a36d-a9c39f28926c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:03.580981 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a0b958e8-b068-4836-a36d-a9c39f28926c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:03.581419 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a0b958e8-b068-4836-a36d-a9c39f28926c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:03.714161 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a0b958e8-b068-4836-a36d-a9c39f28926c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:03.723938 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a0b958e8-b068-4836-a36d-a9c39f28926c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1727 microversion: 2.1 time: 0.156363 May 26 16:46:03.724621 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 274/544] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:46:03 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:46:03.858709 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-24f9a99f-afee-4329-ad27-a657ad2b7fd9 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:03.859828 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-24f9a99f-afee-4329-ad27-a657ad2b7fd9 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:03.866185 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-24f9a99f-afee-4329-ad27-a657ad2b7fd9 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:03.866632 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-24f9a99f-afee-4329-ad27-a657ad2b7fd9 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:03.867392 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-24f9a99f-afee-4329-ad27-a657ad2b7fd9 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:03.867828 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-24f9a99f-afee-4329-ad27-a657ad2b7fd9 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:03.999460 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-24f9a99f-afee-4329-ad27-a657ad2b7fd9 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:04.008338 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-24f9a99f-afee-4329-ad27-a657ad2b7fd9 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:04.009891 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-24f9a99f-afee-4329-ad27-a657ad2b7fd9 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:04.011047 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-24f9a99f-afee-4329-ad27-a657ad2b7fd9 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1750 microversion: 2.20 time: 0.156243 May 26 16:46:04.011607 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 271/545] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:03 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1750 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:04.741669 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-78a413aa-1d27-47c3-9e32-62f1fd8f1338 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:04.742261 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-78a413aa-1d27-47c3-9e32-62f1fd8f1338 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:04.749027 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-78a413aa-1d27-47c3-9e32-62f1fd8f1338 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:04.749484 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-78a413aa-1d27-47c3-9e32-62f1fd8f1338 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:04.750260 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-78a413aa-1d27-47c3-9e32-62f1fd8f1338 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:04.750702 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-78a413aa-1d27-47c3-9e32-62f1fd8f1338 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:04.884600 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-78a413aa-1d27-47c3-9e32-62f1fd8f1338 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:04.893854 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-78a413aa-1d27-47c3-9e32-62f1fd8f1338 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1727 microversion: 2.1 time: 0.155623 May 26 16:46:04.893854 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 275/546] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:46:04 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:46:05.029559 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-740a6ed3-b06d-4962-9cf8-d3ae8349cbbf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:05.030117 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-740a6ed3-b06d-4962-9cf8-d3ae8349cbbf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:05.036667 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-740a6ed3-b06d-4962-9cf8-d3ae8349cbbf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:05.037746 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-740a6ed3-b06d-4962-9cf8-d3ae8349cbbf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:05.038517 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-740a6ed3-b06d-4962-9cf8-d3ae8349cbbf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:05.038958 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-740a6ed3-b06d-4962-9cf8-d3ae8349cbbf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:05.168793 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-740a6ed3-b06d-4962-9cf8-d3ae8349cbbf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:05.177000 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-740a6ed3-b06d-4962-9cf8-d3ae8349cbbf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:05.178541 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-740a6ed3-b06d-4962-9cf8-d3ae8349cbbf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:05.179714 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-740a6ed3-b06d-4962-9cf8-d3ae8349cbbf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1750 microversion: 2.20 time: 0.154184 May 26 16:46:05.180279 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 272/547] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:05 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1750 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:46:05.292866 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-bc07b17c-ffdd-4afc-bb19-57808524f252 req-b57dc2e6-2c49-4683-b5ac-e4bc40d9d57c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a636d450-9d10-45a5-9982-9e10393fc4a9", "name": "network-vif-plugged", "status": "completed", "tag": "444eb6a1-a511-4e39-a006-252d0ba39886"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:46:05.302096 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-bc07b17c-ffdd-4afc-bb19-57808524f252 req-b57dc2e6-2c49-4683-b5ac-e4bc40d9d57c service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:05.302646 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-bc07b17c-ffdd-4afc-bb19-57808524f252 req-b57dc2e6-2c49-4683-b5ac-e4bc40d9d57c service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:05.316222 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-bc07b17c-ffdd-4afc-bb19-57808524f252 req-b57dc2e6-2c49-4683-b5ac-e4bc40d9d57c service nova] Creating event network-vif-plugged:444eb6a1-a511-4e39-a006-252d0ba39886 for instance a636d450-9d10-45a5-9982-9e10393fc4a9 on hv-cinder-83607 May 26 16:46:05.322395 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-bc07b17c-ffdd-4afc-bb19-57808524f252 req-b57dc2e6-2c49-4683-b5ac-e4bc40d9d57c service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033033 May 26 16:46:05.322995 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 276/548] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:46:05.911170 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-1abc0640-5214-4543-abe9-b3cdec82915b tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:05.912243 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-1abc0640-5214-4543-abe9-b3cdec82915b tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:05.918564 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1abc0640-5214-4543-abe9-b3cdec82915b tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:05.919013 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1abc0640-5214-4543-abe9-b3cdec82915b tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:05.919780 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1abc0640-5214-4543-abe9-b3cdec82915b tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:05.920220 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1abc0640-5214-4543-abe9-b3cdec82915b tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:06.051129 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-1abc0640-5214-4543-abe9-b3cdec82915b tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:06.059713 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-1abc0640-5214-4543-abe9-b3cdec82915b tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1727 microversion: 2.1 time: 0.152401 May 26 16:46:06.060281 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 273/549] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:46:05 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:46:06.199740 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-38d91f75-fa67-4f35-9111-e86565a89601 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:06.200347 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-38d91f75-fa67-4f35-9111-e86565a89601 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:06.206684 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-38d91f75-fa67-4f35-9111-e86565a89601 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:06.207113 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-38d91f75-fa67-4f35-9111-e86565a89601 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:06.207974 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-38d91f75-fa67-4f35-9111-e86565a89601 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:06.208454 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-38d91f75-fa67-4f35-9111-e86565a89601 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:06.349989 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-38d91f75-fa67-4f35-9111-e86565a89601 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:06.358134 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-38d91f75-fa67-4f35-9111-e86565a89601 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:06.359659 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-38d91f75-fa67-4f35-9111-e86565a89601 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:06.360876 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-38d91f75-fa67-4f35-9111-e86565a89601 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1750 microversion: 2.20 time: 0.166262 May 26 16:46:06.361444 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 277/550] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:06 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1750 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:46:07.076814 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-3a135ba7-af37-480a-bb28-3e6ead89034c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:07.077418 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-3a135ba7-af37-480a-bb28-3e6ead89034c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:07.083930 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3a135ba7-af37-480a-bb28-3e6ead89034c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:07.084394 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3a135ba7-af37-480a-bb28-3e6ead89034c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:07.085181 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3a135ba7-af37-480a-bb28-3e6ead89034c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:07.085649 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3a135ba7-af37-480a-bb28-3e6ead89034c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:07.217331 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-3a135ba7-af37-480a-bb28-3e6ead89034c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:07.225388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-3a135ba7-af37-480a-bb28-3e6ead89034c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1727 microversion: 2.1 time: 0.152421 May 26 16:46:07.225969 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 274/551] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:46:07 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:46:07.378997 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d798d841-a940-4a0f-a023-ef98e5db97af tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:07.379595 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d798d841-a940-4a0f-a023-ef98e5db97af tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:07.386201 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d798d841-a940-4a0f-a023-ef98e5db97af tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:07.386648 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d798d841-a940-4a0f-a023-ef98e5db97af tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:07.387625 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d798d841-a940-4a0f-a023-ef98e5db97af tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:07.388360 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d798d841-a940-4a0f-a023-ef98e5db97af tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:07.528211 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d798d841-a940-4a0f-a023-ef98e5db97af tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:07.537347 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d798d841-a940-4a0f-a023-ef98e5db97af tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:07.539535 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d798d841-a940-4a0f-a023-ef98e5db97af tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:07.540777 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d798d841-a940-4a0f-a023-ef98e5db97af tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1750 microversion: 2.20 time: 0.165653 May 26 16:46:07.541344 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 278/552] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:07 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1750 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:08.243675 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-c0015632-644e-479e-ab8f-6b77657f0446 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:08.244715 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-c0015632-644e-479e-ab8f-6b77657f0446 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:08.247212 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_api:SELECT=58 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:08.252560 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c0015632-644e-479e-ab8f-6b77657f0446 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:08.253007 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c0015632-644e-479e-ab8f-6b77657f0446 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:08.253774 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c0015632-644e-479e-ab8f-6b77657f0446 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:08.254203 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c0015632-644e-479e-ab8f-6b77657f0446 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:08.383111 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-c0015632-644e-479e-ab8f-6b77657f0446 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:08.385309 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:08.392493 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-c0015632-644e-479e-ab8f-6b77657f0446 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1727 microversion: 2.1 time: 0.153168 May 26 16:46:08.393058 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 275/553] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:46:08 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:46:08.559328 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-460cb231-6366-44d3-b88b-90a20682afff tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:08.559868 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-460cb231-6366-44d3-b88b-90a20682afff tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:08.566326 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-460cb231-6366-44d3-b88b-90a20682afff tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:08.566778 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-460cb231-6366-44d3-b88b-90a20682afff tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:08.567538 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-460cb231-6366-44d3-b88b-90a20682afff tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:08.567968 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-460cb231-6366-44d3-b88b-90a20682afff tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:08.698244 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-460cb231-6366-44d3-b88b-90a20682afff tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:08.711110 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-460cb231-6366-44d3-b88b-90a20682afff tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:08.712656 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-460cb231-6366-44d3-b88b-90a20682afff tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:08.713848 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-460cb231-6366-44d3-b88b-90a20682afff tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1750 microversion: 2.20 time: 0.158516 May 26 16:46:08.714423 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 279/554] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:08 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1750 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:09.410681 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-ffc70a6f-b3cc-47db-b8ef-724d23414ec0 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:09.411301 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-ffc70a6f-b3cc-47db-b8ef-724d23414ec0 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:09.419418 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ffc70a6f-b3cc-47db-b8ef-724d23414ec0 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:09.419856 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ffc70a6f-b3cc-47db-b8ef-724d23414ec0 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:09.420656 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ffc70a6f-b3cc-47db-b8ef-724d23414ec0 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:09.421085 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ffc70a6f-b3cc-47db-b8ef-724d23414ec0 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:09.551077 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-ffc70a6f-b3cc-47db-b8ef-724d23414ec0 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:09.559797 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-ffc70a6f-b3cc-47db-b8ef-724d23414ec0 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1727 microversion: 2.1 time: 0.153287 May 26 16:46:09.560653 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 276/555] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:46:09 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:46:09.853978 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0a93abe0-d0c2-4e88-af2f-2d2e6de23870 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:09.854596 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0a93abe0-d0c2-4e88-af2f-2d2e6de23870 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:09.856687 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=56 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:09.862194 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0a93abe0-d0c2-4e88-af2f-2d2e6de23870 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:09.862656 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0a93abe0-d0c2-4e88-af2f-2d2e6de23870 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:09.863446 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0a93abe0-d0c2-4e88-af2f-2d2e6de23870 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:09.863887 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0a93abe0-d0c2-4e88-af2f-2d2e6de23870 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:10.019877 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0a93abe0-d0c2-4e88-af2f-2d2e6de23870 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:10.030292 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0a93abe0-d0c2-4e88-af2f-2d2e6de23870 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:10.033787 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0a93abe0-d0c2-4e88-af2f-2d2e6de23870 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:10.033787 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0a93abe0-d0c2-4e88-af2f-2d2e6de23870 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1745 microversion: 2.20 time: 0.303988 May 26 16:46:10.034163 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 280/556] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:09 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1745 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:10.578531 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-37354e32-c21d-443e-bcdb-89e7554afb10 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:10.579848 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-37354e32-c21d-443e-bcdb-89e7554afb10 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:10.586734 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-37354e32-c21d-443e-bcdb-89e7554afb10 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:10.587517 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-37354e32-c21d-443e-bcdb-89e7554afb10 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:10.588328 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-37354e32-c21d-443e-bcdb-89e7554afb10 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:10.588796 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-37354e32-c21d-443e-bcdb-89e7554afb10 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:10.733019 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-37354e32-c21d-443e-bcdb-89e7554afb10 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:10.743557 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-37354e32-c21d-443e-bcdb-89e7554afb10 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1727 microversion: 2.1 time: 0.169467 May 26 16:46:10.744467 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 277/557] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:46:10 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:46:11.059124 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-242ccf5f-962b-4f13-af9d-8c0e6964811a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:11.059769 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-242ccf5f-962b-4f13-af9d-8c0e6964811a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:11.066725 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-242ccf5f-962b-4f13-af9d-8c0e6964811a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:11.067458 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-242ccf5f-962b-4f13-af9d-8c0e6964811a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:11.069013 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-242ccf5f-962b-4f13-af9d-8c0e6964811a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:11.069615 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-242ccf5f-962b-4f13-af9d-8c0e6964811a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:11.233621 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-242ccf5f-962b-4f13-af9d-8c0e6964811a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:11.243771 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-242ccf5f-962b-4f13-af9d-8c0e6964811a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:11.245427 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-242ccf5f-962b-4f13-af9d-8c0e6964811a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:11.246918 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-242ccf5f-962b-4f13-af9d-8c0e6964811a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1745 microversion: 2.20 time: 0.191750 May 26 16:46:11.248403 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 281/558] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:11 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1745 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:11.761452 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-451610d2-9ae8-402a-b695-d3fb2f978fcc tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:11.762214 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-451610d2-9ae8-402a-b695-d3fb2f978fcc tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:11.768875 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-451610d2-9ae8-402a-b695-d3fb2f978fcc tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:11.769334 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-451610d2-9ae8-402a-b695-d3fb2f978fcc tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:11.770122 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-451610d2-9ae8-402a-b695-d3fb2f978fcc tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:11.770557 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-451610d2-9ae8-402a-b695-d3fb2f978fcc tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:11.927913 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-451610d2-9ae8-402a-b695-d3fb2f978fcc tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:11.939586 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-451610d2-9ae8-402a-b695-d3fb2f978fcc tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1704 microversion: 2.1 time: 0.182066 May 26 16:46:11.940168 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 278/559] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:46:11 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1704 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:46:11.957745 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-89beeeaf-cb74-4785-8fc2-f8f94d81a6a2 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:46:11.964652 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-89beeeaf-cb74-4785-8fc2-f8f94d81a6a2 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:11.965107 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-89beeeaf-cb74-4785-8fc2-f8f94d81a6a2 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:12.032327 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-89beeeaf-cb74-4785-8fc2-f8f94d81a6a2 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Going to try to start instance {{(pid=124266) start /opt/stack/nova/nova/compute/api.py:2730}} May 26 16:46:12.076912 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-89beeeaf-cb74-4785-8fc2-f8f94d81a6a2 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "POST /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29/action" status: 202 len: 0 microversion: 2.1 time: 0.122897 May 26 16:46:12.077646 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 282/560] 10.222.0.102 () {60 vars in 1282 bytes} [Thu May 26 16:46:11 2022] POST /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 16:46:12.091581 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-17470075-f814-4b61-b1b0-590e7251fe0c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:12.092680 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-17470075-f814-4b61-b1b0-590e7251fe0c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:12.103719 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-17470075-f814-4b61-b1b0-590e7251fe0c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:12.104235 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-17470075-f814-4b61-b1b0-590e7251fe0c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:12.105145 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-17470075-f814-4b61-b1b0-590e7251fe0c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:12.105621 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-17470075-f814-4b61-b1b0-590e7251fe0c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:12.262806 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-17470075-f814-4b61-b1b0-590e7251fe0c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:12.267673 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-629c6bbc-84f7-4649-b255-d972d0f68dc0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:12.268623 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-629c6bbc-84f7-4649-b255-d972d0f68dc0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:12.274122 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-17470075-f814-4b61-b1b0-590e7251fe0c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1713 microversion: 2.1 time: 0.191549 May 26 16:46:12.281141 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-629c6bbc-84f7-4649-b255-d972d0f68dc0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:12.281141 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-629c6bbc-84f7-4649-b255-d972d0f68dc0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:12.281141 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-629c6bbc-84f7-4649-b255-d972d0f68dc0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:12.281141 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-629c6bbc-84f7-4649-b255-d972d0f68dc0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:12.283680 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 279/561] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:46:12 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1713 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:46:12.461804 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-629c6bbc-84f7-4649-b255-d972d0f68dc0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:12.471756 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-629c6bbc-84f7-4649-b255-d972d0f68dc0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:12.473598 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-629c6bbc-84f7-4649-b255-d972d0f68dc0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:12.474926 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-629c6bbc-84f7-4649-b255-d972d0f68dc0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1745 microversion: 2.20 time: 0.213197 May 26 16:46:12.475587 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 283/562] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:12 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1745 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:13.301899 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-731ac5d5-e13e-474b-8aa6-addb89b4fd31 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:13.303944 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-731ac5d5-e13e-474b-8aa6-addb89b4fd31 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:13.325372 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-731ac5d5-e13e-474b-8aa6-addb89b4fd31 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:13.325818 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-731ac5d5-e13e-474b-8aa6-addb89b4fd31 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:13.326598 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-731ac5d5-e13e-474b-8aa6-addb89b4fd31 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:13.327031 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-731ac5d5-e13e-474b-8aa6-addb89b4fd31 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:13.488420 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-731ac5d5-e13e-474b-8aa6-addb89b4fd31 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:13.502003 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-731ac5d5-e13e-474b-8aa6-addb89b4fd31 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1713 microversion: 2.1 time: 0.205140 May 26 16:46:13.504116 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 280/563] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:46:13 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1713 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:46:13.514077 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3d4652cd-d292-4c57-be60-fc8b9b203ed8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:13.514077 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-3d4652cd-d292-4c57-be60-fc8b9b203ed8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:13.526390 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3d4652cd-d292-4c57-be60-fc8b9b203ed8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:13.527417 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3d4652cd-d292-4c57-be60-fc8b9b203ed8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:13.529223 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3d4652cd-d292-4c57-be60-fc8b9b203ed8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:13.530088 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3d4652cd-d292-4c57-be60-fc8b9b203ed8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:13.723093 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3d4652cd-d292-4c57-be60-fc8b9b203ed8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:13.731935 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3d4652cd-d292-4c57-be60-fc8b9b203ed8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:13.733568 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3d4652cd-d292-4c57-be60-fc8b9b203ed8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:13.734761 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-3d4652cd-d292-4c57-be60-fc8b9b203ed8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1745 microversion: 2.20 time: 0.230454 May 26 16:46:13.735321 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 284/564] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:13 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1745 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:46:14.522460 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-66fe2106-d4b8-49c7-83af-cb0c9dbbaff4 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:14.523899 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-66fe2106-d4b8-49c7-83af-cb0c9dbbaff4 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:14.531501 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-66fe2106-d4b8-49c7-83af-cb0c9dbbaff4 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:14.533455 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-66fe2106-d4b8-49c7-83af-cb0c9dbbaff4 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:14.533455 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-66fe2106-d4b8-49c7-83af-cb0c9dbbaff4 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:14.533761 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-66fe2106-d4b8-49c7-83af-cb0c9dbbaff4 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:14.692198 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-66fe2106-d4b8-49c7-83af-cb0c9dbbaff4 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:14.708998 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-66fe2106-d4b8-49c7-83af-cb0c9dbbaff4 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1717 microversion: 2.1 time: 0.190161 May 26 16:46:14.726326 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 281/565] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:46:14 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1717 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:46:14.755454 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-84deb141-2034-43ca-8734-4358aa65835f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:14.756302 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-84deb141-2034-43ca-8734-4358aa65835f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:14.764045 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-84deb141-2034-43ca-8734-4358aa65835f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:14.764774 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-84deb141-2034-43ca-8734-4358aa65835f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:14.765817 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-84deb141-2034-43ca-8734-4358aa65835f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:14.766584 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-84deb141-2034-43ca-8734-4358aa65835f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:14.939388 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-84deb141-2034-43ca-8734-4358aa65835f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:14.951759 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-84deb141-2034-43ca-8734-4358aa65835f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:14.953987 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-84deb141-2034-43ca-8734-4358aa65835f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:14.955333 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-84deb141-2034-43ca-8734-4358aa65835f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1745 microversion: 2.20 time: 0.203645 May 26 16:46:14.955487 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 285/566] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:14 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1745 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:46:15.975720 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-2326f58c-f787-47f5-9119-0cadaa694bb5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:15.976475 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-2326f58c-f787-47f5-9119-0cadaa694bb5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:15.984322 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2326f58c-f787-47f5-9119-0cadaa694bb5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:15.984589 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2326f58c-f787-47f5-9119-0cadaa694bb5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:15.985362 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2326f58c-f787-47f5-9119-0cadaa694bb5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:15.985809 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2326f58c-f787-47f5-9119-0cadaa694bb5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:16.142802 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-2326f58c-f787-47f5-9119-0cadaa694bb5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:16.156124 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-2326f58c-f787-47f5-9119-0cadaa694bb5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:16.158689 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-2326f58c-f787-47f5-9119-0cadaa694bb5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:16.158973 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-2326f58c-f787-47f5-9119-0cadaa694bb5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1745 microversion: 2.20 time: 0.187893 May 26 16:46:16.159537 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 282/567] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:15 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1745 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:17.181300 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-4f2aaedc-d97a-47c2-bd2a-07d75d3be300 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:17.183412 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-4f2aaedc-d97a-47c2-bd2a-07d75d3be300 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:17.200809 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4f2aaedc-d97a-47c2-bd2a-07d75d3be300 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:17.201586 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4f2aaedc-d97a-47c2-bd2a-07d75d3be300 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:17.203218 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4f2aaedc-d97a-47c2-bd2a-07d75d3be300 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:17.203666 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4f2aaedc-d97a-47c2-bd2a-07d75d3be300 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:17.325199 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 16:46:17.325955 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Thu May 26 16:46:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 (ip 10.222.0.102) !!! May 26 16:46:17.362968 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-4f2aaedc-d97a-47c2-bd2a-07d75d3be300 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:17.372770 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-4f2aaedc-d97a-47c2-bd2a-07d75d3be300 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:17.374287 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-4f2aaedc-d97a-47c2-bd2a-07d75d3be300 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:17.375471 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-4f2aaedc-d97a-47c2-bd2a-07d75d3be300 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1745 microversion: 2.20 time: 0.199878 May 26 16:46:17.376020 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 286/568] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:17 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1745 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:18.395714 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-e3b3afbd-ee4d-4aa6-be98-131ae9428a3d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:18.396335 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-e3b3afbd-ee4d-4aa6-be98-131ae9428a3d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:18.404198 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e3b3afbd-ee4d-4aa6-be98-131ae9428a3d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:18.404694 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e3b3afbd-ee4d-4aa6-be98-131ae9428a3d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:18.405489 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e3b3afbd-ee4d-4aa6-be98-131ae9428a3d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:18.405951 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e3b3afbd-ee4d-4aa6-be98-131ae9428a3d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:18.558199 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-e3b3afbd-ee4d-4aa6-be98-131ae9428a3d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:18.566745 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-e3b3afbd-ee4d-4aa6-be98-131ae9428a3d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:18.568875 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-e3b3afbd-ee4d-4aa6-be98-131ae9428a3d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:18.570313 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-e3b3afbd-ee4d-4aa6-be98-131ae9428a3d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1745 microversion: 2.20 time: 0.178763 May 26 16:46:18.571077 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 283/569] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:18 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:19.588546 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9e3bd2d9-0c4d-4087-9e64-bc26b739c156 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:19.589146 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9e3bd2d9-0c4d-4087-9e64-bc26b739c156 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:19.596075 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9e3bd2d9-0c4d-4087-9e64-bc26b739c156 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:19.596565 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9e3bd2d9-0c4d-4087-9e64-bc26b739c156 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:19.597442 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9e3bd2d9-0c4d-4087-9e64-bc26b739c156 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:19.597788 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9e3bd2d9-0c4d-4087-9e64-bc26b739c156 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:19.770054 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9e3bd2d9-0c4d-4087-9e64-bc26b739c156 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:19.780064 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9e3bd2d9-0c4d-4087-9e64-bc26b739c156 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:19.781647 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9e3bd2d9-0c4d-4087-9e64-bc26b739c156 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:19.782849 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9e3bd2d9-0c4d-4087-9e64-bc26b739c156 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1745 microversion: 2.20 time: 0.198354 May 26 16:46:19.783425 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 287/570] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:19 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1745 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:20.803812 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-f1785d27-0dda-45ff-af3f-7cab1d828326 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:20.804816 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-f1785d27-0dda-45ff-af3f-7cab1d828326 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:20.811624 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f1785d27-0dda-45ff-af3f-7cab1d828326 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:20.812060 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f1785d27-0dda-45ff-af3f-7cab1d828326 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:20.812851 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f1785d27-0dda-45ff-af3f-7cab1d828326 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:20.813283 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f1785d27-0dda-45ff-af3f-7cab1d828326 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:20.941785 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-f1785d27-0dda-45ff-af3f-7cab1d828326 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:20.950171 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-f1785d27-0dda-45ff-af3f-7cab1d828326 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:20.951688 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-f1785d27-0dda-45ff-af3f-7cab1d828326 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:20.952862 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-f1785d27-0dda-45ff-af3f-7cab1d828326 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1745 microversion: 2.20 time: 0.155157 May 26 16:46:20.953417 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 284/571] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:20 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:21.971319 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7645c262-1fd3-4e4d-8acc-4083f06a37a6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:21.972028 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-7645c262-1fd3-4e4d-8acc-4083f06a37a6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:21.978851 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7645c262-1fd3-4e4d-8acc-4083f06a37a6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:21.979395 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7645c262-1fd3-4e4d-8acc-4083f06a37a6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:21.980171 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7645c262-1fd3-4e4d-8acc-4083f06a37a6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:21.980894 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7645c262-1fd3-4e4d-8acc-4083f06a37a6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:22.133059 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7645c262-1fd3-4e4d-8acc-4083f06a37a6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:22.141781 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7645c262-1fd3-4e4d-8acc-4083f06a37a6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:22.143387 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7645c262-1fd3-4e4d-8acc-4083f06a37a6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:22.144685 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7645c262-1fd3-4e4d-8acc-4083f06a37a6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1727 microversion: 2.20 time: 0.177285 May 26 16:46:22.145251 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 288/572] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:21 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:46:23.163491 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-a2dee74e-4d69-47d7-8cda-f512b8ee8d75 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:23.164090 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-a2dee74e-4d69-47d7-8cda-f512b8ee8d75 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:23.170962 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a2dee74e-4d69-47d7-8cda-f512b8ee8d75 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:23.171411 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a2dee74e-4d69-47d7-8cda-f512b8ee8d75 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:23.172225 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a2dee74e-4d69-47d7-8cda-f512b8ee8d75 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:23.172693 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a2dee74e-4d69-47d7-8cda-f512b8ee8d75 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:23.304661 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-a2dee74e-4d69-47d7-8cda-f512b8ee8d75 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:23.325195 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-a2dee74e-4d69-47d7-8cda-f512b8ee8d75 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:23.326754 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-a2dee74e-4d69-47d7-8cda-f512b8ee8d75 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:23.327967 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-a2dee74e-4d69-47d7-8cda-f512b8ee8d75 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1727 microversion: 2.20 time: 0.168481 May 26 16:46:23.328579 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 285/573] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:23 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:24.348365 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-04f25974-ee86-4db2-a88c-0750a56c65a5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:24.349829 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-04f25974-ee86-4db2-a88c-0750a56c65a5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:24.356707 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-04f25974-ee86-4db2-a88c-0750a56c65a5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:24.357149 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-04f25974-ee86-4db2-a88c-0750a56c65a5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:24.357900 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-04f25974-ee86-4db2-a88c-0750a56c65a5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:24.358326 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-04f25974-ee86-4db2-a88c-0750a56c65a5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:24.495044 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-04f25974-ee86-4db2-a88c-0750a56c65a5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:24.503336 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-04f25974-ee86-4db2-a88c-0750a56c65a5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:24.504884 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-04f25974-ee86-4db2-a88c-0750a56c65a5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:24.506037 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-04f25974-ee86-4db2-a88c-0750a56c65a5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1727 microversion: 2.20 time: 0.162752 May 26 16:46:24.506604 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 289/574] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:24 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:25.291180 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-d3a816e9-71b6-4629-afa5-83acc8536239 req-0488ec04-a614-401c-946a-9cdddc3007f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a636d450-9d10-45a5-9982-9e10393fc4a9", "name": "network-vif-unplugged", "status": "completed", "tag": "444eb6a1-a511-4e39-a006-252d0ba39886"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:46:25.299775 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-d3a816e9-71b6-4629-afa5-83acc8536239 req-0488ec04-a614-401c-946a-9cdddc3007f8 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:25.300249 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-d3a816e9-71b6-4629-afa5-83acc8536239 req-0488ec04-a614-401c-946a-9cdddc3007f8 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:25.312089 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.compute.server_external_events [req-d3a816e9-71b6-4629-afa5-83acc8536239 req-0488ec04-a614-401c-946a-9cdddc3007f8 service nova] Unable to find a host for instance a636d450-9d10-45a5-9982-9e10393fc4a9. Dropping event network-vif-unplugged {{(pid=124267) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 26 16:46:25.314100 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-d3a816e9-71b6-4629-afa5-83acc8536239 req-0488ec04-a614-401c-946a-9cdddc3007f8 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025797 May 26 16:46:25.314100 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 286/575] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 26 16:46:25.524192 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-c4812520-4581-431a-8341-521d42d344b8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:25.524857 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-c4812520-4581-431a-8341-521d42d344b8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:25.531580 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c4812520-4581-431a-8341-521d42d344b8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:25.532019 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c4812520-4581-431a-8341-521d42d344b8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:25.532811 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c4812520-4581-431a-8341-521d42d344b8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:25.533241 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c4812520-4581-431a-8341-521d42d344b8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:25.535737 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:25.663006 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c4812520-4581-431a-8341-521d42d344b8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:25.671109 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c4812520-4581-431a-8341-521d42d344b8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:25.672660 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c4812520-4581-431a-8341-521d42d344b8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:25.673838 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-c4812520-4581-431a-8341-521d42d344b8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1670 microversion: 2.20 time: 0.153543 May 26 16:46:25.674404 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 290/576] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:25 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:25.692135 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-114cdfea-7f2f-4ed5-b419-71fd02709c35 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b2d8ec6-1482-43a3-b6f4-d6faf41d294c"}} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:46:25.693271 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-114cdfea-7f2f-4ed5-b419-71fd02709c35 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:25.699621 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-114cdfea-7f2f-4ed5-b419-71fd02709c35 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:25.700099 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-114cdfea-7f2f-4ed5-b419-71fd02709c35 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:25.700899 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-114cdfea-7f2f-4ed5-b419-71fd02709c35 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:25.701334 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-114cdfea-7f2f-4ed5-b419-71fd02709c35 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:26.006904 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-114cdfea-7f2f-4ed5-b419-71fd02709c35 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "POST /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.318678 May 26 16:46:26.007745 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 287/577] 10.222.0.102 () {62 vars in 1368 bytes} [Thu May 26 16:46:25 2022] POST /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9/os-volume_attachments => generated 188 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:46:26.124117 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-18bb4127-5f2d-4691-8b21-eb0425546563 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:46:26.124719 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-18bb4127-5f2d-4691-8b21-eb0425546563 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:26.131917 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-18bb4127-5f2d-4691-8b21-eb0425546563 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:26.132462 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-18bb4127-5f2d-4691-8b21-eb0425546563 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:26.133358 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-18bb4127-5f2d-4691-8b21-eb0425546563 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:26.133889 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-18bb4127-5f2d-4691-8b21-eb0425546563 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:26.270203 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-18bb4127-5f2d-4691-8b21-eb0425546563 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "POST /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9/action" status: 202 len: 0 microversion: 2.20 time: 0.149931 May 26 16:46:26.270878 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 291/578] 10.222.0.102 () {62 vars in 1323 bytes} [Thu May 26 16:46:26 2022] POST /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 16:46:26.279572 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-02a9af97-673c-4bde-9613-37ab03921c44 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:26.280272 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-02a9af97-673c-4bde-9613-37ab03921c44 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:26.287093 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-02a9af97-673c-4bde-9613-37ab03921c44 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:26.287551 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-02a9af97-673c-4bde-9613-37ab03921c44 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:26.288346 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-02a9af97-673c-4bde-9613-37ab03921c44 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:26.288813 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-02a9af97-673c-4bde-9613-37ab03921c44 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:26.423865 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-02a9af97-673c-4bde-9613-37ab03921c44 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:26.433327 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-02a9af97-673c-4bde-9613-37ab03921c44 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:26.434832 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-02a9af97-673c-4bde-9613-37ab03921c44 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:26.435979 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-02a9af97-673c-4bde-9613-37ab03921c44 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1756 microversion: 2.20 time: 0.160300 May 26 16:46:26.436572 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 288/579] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:26 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:27.455355 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-dcaf344d-9949-48c8-9be4-cfe37216f79d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:27.455997 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-dcaf344d-9949-48c8-9be4-cfe37216f79d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:27.462118 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dcaf344d-9949-48c8-9be4-cfe37216f79d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:27.462568 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dcaf344d-9949-48c8-9be4-cfe37216f79d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:27.463336 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dcaf344d-9949-48c8-9be4-cfe37216f79d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:27.463769 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dcaf344d-9949-48c8-9be4-cfe37216f79d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:27.594902 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-dcaf344d-9949-48c8-9be4-cfe37216f79d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:27.603855 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-dcaf344d-9949-48c8-9be4-cfe37216f79d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:27.605471 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-dcaf344d-9949-48c8-9be4-cfe37216f79d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:27.606618 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-dcaf344d-9949-48c8-9be4-cfe37216f79d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1758 microversion: 2.20 time: 0.155848 May 26 16:46:27.607170 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 292/580] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:27 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1758 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:46:28.625941 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-125f67d8-0f05-43bd-b49f-df08b92c99b8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:28.626498 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-125f67d8-0f05-43bd-b49f-df08b92c99b8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:28.633471 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-125f67d8-0f05-43bd-b49f-df08b92c99b8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:28.633915 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-125f67d8-0f05-43bd-b49f-df08b92c99b8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:28.634679 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-125f67d8-0f05-43bd-b49f-df08b92c99b8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:28.635110 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-125f67d8-0f05-43bd-b49f-df08b92c99b8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:28.764595 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-125f67d8-0f05-43bd-b49f-df08b92c99b8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:28.773250 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-125f67d8-0f05-43bd-b49f-df08b92c99b8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:28.774748 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-125f67d8-0f05-43bd-b49f-df08b92c99b8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:28.775896 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-125f67d8-0f05-43bd-b49f-df08b92c99b8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1814 microversion: 2.20 time: 0.154098 May 26 16:46:28.776473 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 289/581] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:28 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1814 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:29.794611 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-37bc8787-2b4b-4ab5-9e9a-2b36ce6905c7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:29.795285 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-37bc8787-2b4b-4ab5-9e9a-2b36ce6905c7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:29.801885 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-37bc8787-2b4b-4ab5-9e9a-2b36ce6905c7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:29.802431 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-37bc8787-2b4b-4ab5-9e9a-2b36ce6905c7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:29.803223 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-37bc8787-2b4b-4ab5-9e9a-2b36ce6905c7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:29.803659 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-37bc8787-2b4b-4ab5-9e9a-2b36ce6905c7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:29.962652 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-37bc8787-2b4b-4ab5-9e9a-2b36ce6905c7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:29.974982 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-37bc8787-2b4b-4ab5-9e9a-2b36ce6905c7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:29.977624 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-37bc8787-2b4b-4ab5-9e9a-2b36ce6905c7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:29.979211 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-37bc8787-2b4b-4ab5-9e9a-2b36ce6905c7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1814 microversion: 2.20 time: 0.188462 May 26 16:46:29.980066 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 293/582] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:29 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1814 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:31.008060 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-b1e24421-82e4-4a03-95cc-5e8583a70f04 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:31.008752 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-b1e24421-82e4-4a03-95cc-5e8583a70f04 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:31.016714 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b1e24421-82e4-4a03-95cc-5e8583a70f04 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:31.017160 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b1e24421-82e4-4a03-95cc-5e8583a70f04 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:31.017926 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b1e24421-82e4-4a03-95cc-5e8583a70f04 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:31.018354 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b1e24421-82e4-4a03-95cc-5e8583a70f04 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:31.037086 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:31.172137 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-b1e24421-82e4-4a03-95cc-5e8583a70f04 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:31.181498 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-b1e24421-82e4-4a03-95cc-5e8583a70f04 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:31.183029 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-b1e24421-82e4-4a03-95cc-5e8583a70f04 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:31.184210 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-b1e24421-82e4-4a03-95cc-5e8583a70f04 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1814 microversion: 2.20 time: 0.180169 May 26 16:46:31.185284 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 290/583] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:31 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1814 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:32.202968 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-cdbb76d1-553a-4de8-b7ef-64a4b817ecf6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:32.204267 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-cdbb76d1-553a-4de8-b7ef-64a4b817ecf6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:32.212217 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cdbb76d1-553a-4de8-b7ef-64a4b817ecf6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:32.213003 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cdbb76d1-553a-4de8-b7ef-64a4b817ecf6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:32.214044 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cdbb76d1-553a-4de8-b7ef-64a4b817ecf6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:32.214675 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cdbb76d1-553a-4de8-b7ef-64a4b817ecf6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:32.380384 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-cdbb76d1-553a-4de8-b7ef-64a4b817ecf6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:32.388806 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-cdbb76d1-553a-4de8-b7ef-64a4b817ecf6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:32.390316 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-cdbb76d1-553a-4de8-b7ef-64a4b817ecf6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:32.391472 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-cdbb76d1-553a-4de8-b7ef-64a4b817ecf6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1814 microversion: 2.20 time: 0.192539 May 26 16:46:32.392033 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 294/584] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:32 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1814 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:33.410939 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-9caefae5-f28b-4b34-b4d1-6a65e083e1bf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:33.412053 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-9caefae5-f28b-4b34-b4d1-6a65e083e1bf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:33.419895 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9caefae5-f28b-4b34-b4d1-6a65e083e1bf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:33.420355 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9caefae5-f28b-4b34-b4d1-6a65e083e1bf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:33.421140 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9caefae5-f28b-4b34-b4d1-6a65e083e1bf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:33.421570 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9caefae5-f28b-4b34-b4d1-6a65e083e1bf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:33.570185 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-9caefae5-f28b-4b34-b4d1-6a65e083e1bf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:33.586261 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-9caefae5-f28b-4b34-b4d1-6a65e083e1bf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:33.589548 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-9caefae5-f28b-4b34-b4d1-6a65e083e1bf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:33.592016 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-9caefae5-f28b-4b34-b4d1-6a65e083e1bf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1814 microversion: 2.20 time: 0.185021 May 26 16:46:33.593168 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 291/585] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:33 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1814 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:34.611465 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1d24b88b-f076-406d-a876-6d4a41ddab37 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:34.612217 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1d24b88b-f076-406d-a876-6d4a41ddab37 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:34.619767 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1d24b88b-f076-406d-a876-6d4a41ddab37 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:34.620210 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1d24b88b-f076-406d-a876-6d4a41ddab37 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:34.621279 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1d24b88b-f076-406d-a876-6d4a41ddab37 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:34.621712 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1d24b88b-f076-406d-a876-6d4a41ddab37 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:34.766690 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1d24b88b-f076-406d-a876-6d4a41ddab37 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:34.775621 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1d24b88b-f076-406d-a876-6d4a41ddab37 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:34.777183 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1d24b88b-f076-406d-a876-6d4a41ddab37 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:34.778363 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1d24b88b-f076-406d-a876-6d4a41ddab37 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1814 microversion: 2.20 time: 0.171409 May 26 16:46:34.779139 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 295/586] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:34 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1814 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:35.798299 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-19f8d83b-3a37-4d09-8322-967d83cc88cb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:35.799229 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-19f8d83b-3a37-4d09-8322-967d83cc88cb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:35.807039 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-19f8d83b-3a37-4d09-8322-967d83cc88cb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:35.807481 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-19f8d83b-3a37-4d09-8322-967d83cc88cb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:35.808252 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-19f8d83b-3a37-4d09-8322-967d83cc88cb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:35.808721 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-19f8d83b-3a37-4d09-8322-967d83cc88cb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:35.948860 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-19f8d83b-3a37-4d09-8322-967d83cc88cb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:35.959767 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-19f8d83b-3a37-4d09-8322-967d83cc88cb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:35.961298 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-19f8d83b-3a37-4d09-8322-967d83cc88cb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:35.962486 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-19f8d83b-3a37-4d09-8322-967d83cc88cb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1814 microversion: 2.20 time: 0.169085 May 26 16:46:35.963053 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 292/587] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:35 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1814 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:36.981158 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-5be34fd4-e684-4d9f-ac74-e0cbdb56e41c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:36.981765 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-5be34fd4-e684-4d9f-ac74-e0cbdb56e41c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:36.988696 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5be34fd4-e684-4d9f-ac74-e0cbdb56e41c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:36.989120 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5be34fd4-e684-4d9f-ac74-e0cbdb56e41c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:36.989896 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5be34fd4-e684-4d9f-ac74-e0cbdb56e41c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:36.990329 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5be34fd4-e684-4d9f-ac74-e0cbdb56e41c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:37.129514 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-5be34fd4-e684-4d9f-ac74-e0cbdb56e41c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:37.139418 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-5be34fd4-e684-4d9f-ac74-e0cbdb56e41c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:37.140991 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-5be34fd4-e684-4d9f-ac74-e0cbdb56e41c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:37.142428 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-5be34fd4-e684-4d9f-ac74-e0cbdb56e41c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1814 microversion: 2.20 time: 0.165178 May 26 16:46:37.143444 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 296/588] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:36 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1814 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:38.162560 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-9a9de0a6-923d-47eb-82d4-45d01bc95352 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:38.163342 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-9a9de0a6-923d-47eb-82d4-45d01bc95352 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:38.170880 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9a9de0a6-923d-47eb-82d4-45d01bc95352 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:38.171278 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9a9de0a6-923d-47eb-82d4-45d01bc95352 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:38.172170 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9a9de0a6-923d-47eb-82d4-45d01bc95352 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:38.172642 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9a9de0a6-923d-47eb-82d4-45d01bc95352 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:38.330609 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-9a9de0a6-923d-47eb-82d4-45d01bc95352 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:38.339643 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-9a9de0a6-923d-47eb-82d4-45d01bc95352 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:38.341308 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-9a9de0a6-923d-47eb-82d4-45d01bc95352 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:38.342486 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-9a9de0a6-923d-47eb-82d4-45d01bc95352 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1814 microversion: 2.20 time: 0.184735 May 26 16:46:38.343728 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 293/589] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:38 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1814 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:46:39.362041 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f3792caf-b19c-458b-a3c6-8167e184ed72 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:39.362670 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f3792caf-b19c-458b-a3c6-8167e184ed72 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:39.369811 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f3792caf-b19c-458b-a3c6-8167e184ed72 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:39.370266 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f3792caf-b19c-458b-a3c6-8167e184ed72 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:39.371038 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f3792caf-b19c-458b-a3c6-8167e184ed72 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:39.371482 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f3792caf-b19c-458b-a3c6-8167e184ed72 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:39.510624 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f3792caf-b19c-458b-a3c6-8167e184ed72 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:39.521571 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f3792caf-b19c-458b-a3c6-8167e184ed72 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:39.523075 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f3792caf-b19c-458b-a3c6-8167e184ed72 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:39.524411 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f3792caf-b19c-458b-a3c6-8167e184ed72 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1814 microversion: 2.20 time: 0.166400 May 26 16:46:39.525033 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 297/590] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:39 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1814 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:40.543132 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-7e77dd8b-b00a-4980-9b37-fa66126d0e44 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:40.543766 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-7e77dd8b-b00a-4980-9b37-fa66126d0e44 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:40.546051 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_api:SELECT=38 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:40.551341 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7e77dd8b-b00a-4980-9b37-fa66126d0e44 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:40.552465 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7e77dd8b-b00a-4980-9b37-fa66126d0e44 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:40.553232 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7e77dd8b-b00a-4980-9b37-fa66126d0e44 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:40.553671 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7e77dd8b-b00a-4980-9b37-fa66126d0e44 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:40.692244 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-7e77dd8b-b00a-4980-9b37-fa66126d0e44 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:40.701490 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-7e77dd8b-b00a-4980-9b37-fa66126d0e44 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:40.703005 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-7e77dd8b-b00a-4980-9b37-fa66126d0e44 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:40.704158 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-7e77dd8b-b00a-4980-9b37-fa66126d0e44 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1814 microversion: 2.20 time: 0.164919 May 26 16:46:40.704751 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 294/591] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:40 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1814 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:41.723195 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0856f8e3-fd50-4dd4-86f0-dd9fa009b8ec tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:41.723885 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0856f8e3-fd50-4dd4-86f0-dd9fa009b8ec tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:41.726216 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=38 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:41.732036 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0856f8e3-fd50-4dd4-86f0-dd9fa009b8ec tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:41.732516 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0856f8e3-fd50-4dd4-86f0-dd9fa009b8ec tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:41.733296 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0856f8e3-fd50-4dd4-86f0-dd9fa009b8ec tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:41.733735 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0856f8e3-fd50-4dd4-86f0-dd9fa009b8ec tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:41.877206 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0856f8e3-fd50-4dd4-86f0-dd9fa009b8ec tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:41.887128 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0856f8e3-fd50-4dd4-86f0-dd9fa009b8ec tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:41.888710 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0856f8e3-fd50-4dd4-86f0-dd9fa009b8ec tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:41.889895 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0856f8e3-fd50-4dd4-86f0-dd9fa009b8ec tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1814 microversion: 2.20 time: 0.170651 May 26 16:46:41.890464 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 298/592] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:41 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1814 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:42.908784 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-a0fa3638-e41e-45c6-9675-03fe1057e333 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:42.909719 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-a0fa3638-e41e-45c6-9675-03fe1057e333 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:42.916566 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a0fa3638-e41e-45c6-9675-03fe1057e333 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:42.917112 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a0fa3638-e41e-45c6-9675-03fe1057e333 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:42.917992 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a0fa3638-e41e-45c6-9675-03fe1057e333 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:42.918487 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a0fa3638-e41e-45c6-9675-03fe1057e333 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:43.085944 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-a0fa3638-e41e-45c6-9675-03fe1057e333 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:43.096196 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-a0fa3638-e41e-45c6-9675-03fe1057e333 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:43.097760 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-a0fa3638-e41e-45c6-9675-03fe1057e333 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:43.099582 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-a0fa3638-e41e-45c6-9675-03fe1057e333 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1814 microversion: 2.20 time: 0.195269 May 26 16:46:43.100156 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 295/593] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:42 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1814 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:46:44.121759 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8900a3e4-dcea-4e7b-b094-a16acfc86e98 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:44.122391 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-8900a3e4-dcea-4e7b-b094-a16acfc86e98 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:44.129169 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8900a3e4-dcea-4e7b-b094-a16acfc86e98 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:44.129692 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8900a3e4-dcea-4e7b-b094-a16acfc86e98 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:44.130481 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8900a3e4-dcea-4e7b-b094-a16acfc86e98 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:44.130928 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8900a3e4-dcea-4e7b-b094-a16acfc86e98 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:44.276318 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8900a3e4-dcea-4e7b-b094-a16acfc86e98 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:44.286276 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8900a3e4-dcea-4e7b-b094-a16acfc86e98 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:44.287871 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8900a3e4-dcea-4e7b-b094-a16acfc86e98 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:44.289159 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-8900a3e4-dcea-4e7b-b094-a16acfc86e98 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1814 microversion: 2.20 time: 0.173885 May 26 16:46:44.289968 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 299/594] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:44 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1814 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:45.310466 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-fb61e672-fdb2-4646-ad17-78b00599a5d5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:45.313946 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-fb61e672-fdb2-4646-ad17-78b00599a5d5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:45.321752 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fb61e672-fdb2-4646-ad17-78b00599a5d5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:45.322277 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fb61e672-fdb2-4646-ad17-78b00599a5d5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:45.323125 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fb61e672-fdb2-4646-ad17-78b00599a5d5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:45.323848 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fb61e672-fdb2-4646-ad17-78b00599a5d5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:45.466188 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-fb61e672-fdb2-4646-ad17-78b00599a5d5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:45.475976 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-fb61e672-fdb2-4646-ad17-78b00599a5d5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:45.477548 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-fb61e672-fdb2-4646-ad17-78b00599a5d5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:45.478797 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-fb61e672-fdb2-4646-ad17-78b00599a5d5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1814 microversion: 2.20 time: 0.174065 May 26 16:46:45.479328 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 296/595] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:45 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1814 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:46.497747 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3d05ffae-cb2d-4d32-a0dd-d9d9359450c3 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:46.498645 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-3d05ffae-cb2d-4d32-a0dd-d9d9359450c3 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:46.506283 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3d05ffae-cb2d-4d32-a0dd-d9d9359450c3 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:46.507027 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3d05ffae-cb2d-4d32-a0dd-d9d9359450c3 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:46.508014 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3d05ffae-cb2d-4d32-a0dd-d9d9359450c3 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:46.508670 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3d05ffae-cb2d-4d32-a0dd-d9d9359450c3 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:46.660071 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3d05ffae-cb2d-4d32-a0dd-d9d9359450c3 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:46.670031 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3d05ffae-cb2d-4d32-a0dd-d9d9359450c3 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:46.671552 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3d05ffae-cb2d-4d32-a0dd-d9d9359450c3 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:46.672867 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-3d05ffae-cb2d-4d32-a0dd-d9d9359450c3 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1814 microversion: 2.20 time: 0.179475 May 26 16:46:46.673496 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 300/596] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:46 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1814 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:47.692992 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-00acc599-5b55-461b-ae37-67a6b073368b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:47.693796 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-00acc599-5b55-461b-ae37-67a6b073368b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:47.701377 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-00acc599-5b55-461b-ae37-67a6b073368b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:47.701844 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-00acc599-5b55-461b-ae37-67a6b073368b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:47.702686 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-00acc599-5b55-461b-ae37-67a6b073368b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:47.703325 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-00acc599-5b55-461b-ae37-67a6b073368b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:47.854601 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-00acc599-5b55-461b-ae37-67a6b073368b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:47.864172 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-00acc599-5b55-461b-ae37-67a6b073368b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:47.865744 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-00acc599-5b55-461b-ae37-67a6b073368b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:47.866952 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-00acc599-5b55-461b-ae37-67a6b073368b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1814 microversion: 2.20 time: 0.178287 May 26 16:46:47.867524 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 297/597] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:47 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1814 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:48.887086 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ce4dbfb2-365a-4755-807c-3255d49cbb8d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:48.887769 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ce4dbfb2-365a-4755-807c-3255d49cbb8d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:48.894797 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ce4dbfb2-365a-4755-807c-3255d49cbb8d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:48.895251 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ce4dbfb2-365a-4755-807c-3255d49cbb8d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:48.896031 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ce4dbfb2-365a-4755-807c-3255d49cbb8d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:48.896499 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ce4dbfb2-365a-4755-807c-3255d49cbb8d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:49.054276 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ce4dbfb2-365a-4755-807c-3255d49cbb8d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:49.064667 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ce4dbfb2-365a-4755-807c-3255d49cbb8d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:49.066171 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ce4dbfb2-365a-4755-807c-3255d49cbb8d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:49.067347 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ce4dbfb2-365a-4755-807c-3255d49cbb8d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1814 microversion: 2.20 time: 0.184858 May 26 16:46:49.067908 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 301/598] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:48 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1814 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:46:50.087134 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-a2b0a8ba-28d2-4739-8a84-c0292c8df8b0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:50.087778 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-a2b0a8ba-28d2-4739-8a84-c0292c8df8b0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:50.094769 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a2b0a8ba-28d2-4739-8a84-c0292c8df8b0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:50.095218 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a2b0a8ba-28d2-4739-8a84-c0292c8df8b0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:50.095998 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a2b0a8ba-28d2-4739-8a84-c0292c8df8b0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:50.096625 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a2b0a8ba-28d2-4739-8a84-c0292c8df8b0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:50.497089 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-a2b0a8ba-28d2-4739-8a84-c0292c8df8b0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:50.505956 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-a2b0a8ba-28d2-4739-8a84-c0292c8df8b0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:50.507577 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-a2b0a8ba-28d2-4739-8a84-c0292c8df8b0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:50.508648 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-a2b0a8ba-28d2-4739-8a84-c0292c8df8b0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1814 microversion: 2.20 time: 0.425654 May 26 16:46:50.509206 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 298/599] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:50 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1814 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:51.527514 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-346d49d3-9e3a-4603-9d65-9605ebf1b1f0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:51.528157 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-346d49d3-9e3a-4603-9d65-9605ebf1b1f0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:51.535230 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-346d49d3-9e3a-4603-9d65-9605ebf1b1f0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:51.536234 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-346d49d3-9e3a-4603-9d65-9605ebf1b1f0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:51.537054 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-346d49d3-9e3a-4603-9d65-9605ebf1b1f0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:51.537486 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-346d49d3-9e3a-4603-9d65-9605ebf1b1f0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:51.681398 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-346d49d3-9e3a-4603-9d65-9605ebf1b1f0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:51.690881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-346d49d3-9e3a-4603-9d65-9605ebf1b1f0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:51.693028 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-346d49d3-9e3a-4603-9d65-9605ebf1b1f0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:51.694262 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-346d49d3-9e3a-4603-9d65-9605ebf1b1f0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1814 microversion: 2.20 time: 0.170898 May 26 16:46:51.695092 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 302/600] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:51 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1814 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:52.713692 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-df3a4f7a-741d-46a4-8aa4-a1d44d27f6f2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:52.714290 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-df3a4f7a-741d-46a4-8aa4-a1d44d27f6f2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:52.720883 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-df3a4f7a-741d-46a4-8aa4-a1d44d27f6f2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:52.721323 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-df3a4f7a-741d-46a4-8aa4-a1d44d27f6f2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:52.722087 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-df3a4f7a-741d-46a4-8aa4-a1d44d27f6f2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:52.722519 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-df3a4f7a-741d-46a4-8aa4-a1d44d27f6f2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:52.867463 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-df3a4f7a-741d-46a4-8aa4-a1d44d27f6f2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:52.877638 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-df3a4f7a-741d-46a4-8aa4-a1d44d27f6f2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:52.879190 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-df3a4f7a-741d-46a4-8aa4-a1d44d27f6f2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:52.880422 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-df3a4f7a-741d-46a4-8aa4-a1d44d27f6f2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1814 microversion: 2.20 time: 0.170905 May 26 16:46:52.881004 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 299/601] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:52 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1814 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:52.992015 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-849c0161-cb42-4c0b-9ac3-4573148c5f3d tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f7cea50-f290-429b-b903-b729aed245c2"}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:46:52.993253 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-849c0161-cb42-4c0b-9ac3-4573148c5f3d tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:53.000060 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-849c0161-cb42-4c0b-9ac3-4573148c5f3d tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:53.000556 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-849c0161-cb42-4c0b-9ac3-4573148c5f3d tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:53.001364 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-849c0161-cb42-4c0b-9ac3-4573148c5f3d tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:53.001807 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-849c0161-cb42-4c0b-9ac3-4573148c5f3d tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:53.899782 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-cb4bb6c9-9e34-4720-9f7f-b280d27b993d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:53.900396 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-cb4bb6c9-9e34-4720-9f7f-b280d27b993d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:53.907448 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-cb4bb6c9-9e34-4720-9f7f-b280d27b993d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:53.907894 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-cb4bb6c9-9e34-4720-9f7f-b280d27b993d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:53.908732 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-cb4bb6c9-9e34-4720-9f7f-b280d27b993d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:53.909163 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-cb4bb6c9-9e34-4720-9f7f-b280d27b993d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:54.043579 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-cb4bb6c9-9e34-4720-9f7f-b280d27b993d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:54.052394 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-cb4bb6c9-9e34-4720-9f7f-b280d27b993d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:54.053938 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-cb4bb6c9-9e34-4720-9f7f-b280d27b993d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:54.055141 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-cb4bb6c9-9e34-4720-9f7f-b280d27b993d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1814 microversion: 2.20 time: 0.159273 May 26 16:46:54.055710 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 300/602] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:53 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1814 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:46:55.074405 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-8d2a0209-ee00-4bcf-a501-2c42dea0f582 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:55.075444 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-8d2a0209-ee00-4bcf-a501-2c42dea0f582 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:55.082970 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8d2a0209-ee00-4bcf-a501-2c42dea0f582 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:55.083507 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8d2a0209-ee00-4bcf-a501-2c42dea0f582 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:55.084592 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8d2a0209-ee00-4bcf-a501-2c42dea0f582 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:55.085150 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8d2a0209-ee00-4bcf-a501-2c42dea0f582 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:55.105540 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-849c0161-cb42-4c0b-9ac3-4573148c5f3d tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "POST /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.219745 May 26 16:46:55.106159 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 303/603] 10.222.0.102 () {60 vars in 1327 bytes} [Thu May 26 16:46:52 2022] POST /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934/os-volume_attachments => generated 194 bytes in 2222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:46:55.251380 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-8d2a0209-ee00-4bcf-a501-2c42dea0f582 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:55.262660 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-8d2a0209-ee00-4bcf-a501-2c42dea0f582 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:55.264211 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-8d2a0209-ee00-4bcf-a501-2c42dea0f582 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:55.265850 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-8d2a0209-ee00-4bcf-a501-2c42dea0f582 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1814 microversion: 2.20 time: 0.196219 May 26 16:46:55.266697 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 301/604] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:55 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1814 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:46:56.286774 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-68f5f30c-93d6-4809-a216-848c64db97a5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:56.287471 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-68f5f30c-93d6-4809-a216-848c64db97a5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:56.294707 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-68f5f30c-93d6-4809-a216-848c64db97a5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:56.295151 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-68f5f30c-93d6-4809-a216-848c64db97a5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:56.295932 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-68f5f30c-93d6-4809-a216-848c64db97a5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:56.296386 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-68f5f30c-93d6-4809-a216-848c64db97a5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:56.301722 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:56.460908 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-68f5f30c-93d6-4809-a216-848c64db97a5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:56.470442 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-68f5f30c-93d6-4809-a216-848c64db97a5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:56.472000 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-68f5f30c-93d6-4809-a216-848c64db97a5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:56.473924 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-68f5f30c-93d6-4809-a216-848c64db97a5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1814 microversion: 2.20 time: 0.191924 May 26 16:46:56.474500 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 304/605] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:56 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1814 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:57.494693 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-a8b790de-c86a-4d3d-a938-21505aa095c5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:57.495298 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-a8b790de-c86a-4d3d-a938-21505aa095c5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:57.502163 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a8b790de-c86a-4d3d-a938-21505aa095c5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:57.502621 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a8b790de-c86a-4d3d-a938-21505aa095c5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:57.503414 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a8b790de-c86a-4d3d-a938-21505aa095c5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:57.503849 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a8b790de-c86a-4d3d-a938-21505aa095c5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:57.640983 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-a8b790de-c86a-4d3d-a938-21505aa095c5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:57.651843 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-a8b790de-c86a-4d3d-a938-21505aa095c5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:57.653700 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-a8b790de-c86a-4d3d-a938-21505aa095c5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:57.654901 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-a8b790de-c86a-4d3d-a938-21505aa095c5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1814 microversion: 2.20 time: 0.165318 May 26 16:46:57.655460 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 302/606] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:57 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1814 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:57.829996 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-cd2eeb6c-a573-4775-9adb-59a5a63d7005 req-0ea22937-276a-492a-ad93-fe0f16016594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a636d450-9d10-45a5-9982-9e10393fc4a9", "name": "network-vif-plugged", "status": "completed", "tag": "444eb6a1-a511-4e39-a006-252d0ba39886"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:46:57.838471 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-cd2eeb6c-a573-4775-9adb-59a5a63d7005 req-0ea22937-276a-492a-ad93-fe0f16016594 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:57.838930 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-cd2eeb6c-a573-4775-9adb-59a5a63d7005 req-0ea22937-276a-492a-ad93-fe0f16016594 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:57.850513 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-cd2eeb6c-a573-4775-9adb-59a5a63d7005 req-0ea22937-276a-492a-ad93-fe0f16016594 service nova] Creating event network-vif-plugged:444eb6a1-a511-4e39-a006-252d0ba39886 for instance a636d450-9d10-45a5-9982-9e10393fc4a9 on hv-cinder-83607 May 26 16:46:57.855439 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-cd2eeb6c-a573-4775-9adb-59a5a63d7005 req-0ea22937-276a-492a-ad93-fe0f16016594 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086686 May 26 16:46:57.856009 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 305/607] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:46:58.673272 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-6b607cae-ed40-454e-8b77-2495ebf81514 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:58.673853 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-6b607cae-ed40-454e-8b77-2495ebf81514 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:58.681068 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-6b607cae-ed40-454e-8b77-2495ebf81514 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:58.681516 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-6b607cae-ed40-454e-8b77-2495ebf81514 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:58.682286 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-6b607cae-ed40-454e-8b77-2495ebf81514 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:58.682726 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-6b607cae-ed40-454e-8b77-2495ebf81514 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:58.824021 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-6b607cae-ed40-454e-8b77-2495ebf81514 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:58.833433 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-6b607cae-ed40-454e-8b77-2495ebf81514 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:58.834948 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-6b607cae-ed40-454e-8b77-2495ebf81514 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:46:58.836118 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-6b607cae-ed40-454e-8b77-2495ebf81514 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1814 microversion: 2.20 time: 0.166850 May 26 16:46:58.836719 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 303/608] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:58 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1814 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:46:59.855336 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-cf55cea6-5068-4ca2-90ab-a03f11f8f629 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:46:59.856034 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-cf55cea6-5068-4ca2-90ab-a03f11f8f629 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:46:59.862609 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cf55cea6-5068-4ca2-90ab-a03f11f8f629 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:59.863059 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cf55cea6-5068-4ca2-90ab-a03f11f8f629 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:46:59.863853 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cf55cea6-5068-4ca2-90ab-a03f11f8f629 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:46:59.864296 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cf55cea6-5068-4ca2-90ab-a03f11f8f629 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:00.012686 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-cf55cea6-5068-4ca2-90ab-a03f11f8f629 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:00.022305 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-cf55cea6-5068-4ca2-90ab-a03f11f8f629 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:00.023832 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-cf55cea6-5068-4ca2-90ab-a03f11f8f629 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:00.025072 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-cf55cea6-5068-4ca2-90ab-a03f11f8f629 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1814 microversion: 2.20 time: 0.174608 May 26 16:47:00.025648 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 306/609] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:46:59 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1814 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:47:01.042936 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-68030adf-debd-4e29-8f5d-cf04ae909375 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:01.043539 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-68030adf-debd-4e29-8f5d-cf04ae909375 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:01.051341 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-68030adf-debd-4e29-8f5d-cf04ae909375 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:01.051793 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-68030adf-debd-4e29-8f5d-cf04ae909375 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:01.053085 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-68030adf-debd-4e29-8f5d-cf04ae909375 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:01.053528 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-68030adf-debd-4e29-8f5d-cf04ae909375 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:01.070953 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=84 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:01.210835 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-68030adf-debd-4e29-8f5d-cf04ae909375 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:01.221387 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-68030adf-debd-4e29-8f5d-cf04ae909375 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:01.223253 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-68030adf-debd-4e29-8f5d-cf04ae909375 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:01.224875 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-68030adf-debd-4e29-8f5d-cf04ae909375 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1814 microversion: 2.20 time: 0.185539 May 26 16:47:01.225526 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 304/610] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:47:01 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1814 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:47:02.243368 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-83b14439-d9dd-45fc-94a9-9b1267aeb692 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:02.244501 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-83b14439-d9dd-45fc-94a9-9b1267aeb692 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:02.250806 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-83b14439-d9dd-45fc-94a9-9b1267aeb692 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:02.251250 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-83b14439-d9dd-45fc-94a9-9b1267aeb692 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:02.252015 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-83b14439-d9dd-45fc-94a9-9b1267aeb692 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:02.252476 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-83b14439-d9dd-45fc-94a9-9b1267aeb692 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:02.387988 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-83b14439-d9dd-45fc-94a9-9b1267aeb692 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:02.397575 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-83b14439-d9dd-45fc-94a9-9b1267aeb692 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:02.399147 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-83b14439-d9dd-45fc-94a9-9b1267aeb692 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:02.400349 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-83b14439-d9dd-45fc-94a9-9b1267aeb692 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1801 microversion: 2.20 time: 0.160970 May 26 16:47:02.400975 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 307/611] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:47:02 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:47:03.721233 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-d6300ca5-ae3f-4475-925d-dff51ab5556a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:47:03.722291 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-d6300ca5-ae3f-4475-925d-dff51ab5556a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:03.729569 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d6300ca5-ae3f-4475-925d-dff51ab5556a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:03.730020 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d6300ca5-ae3f-4475-925d-dff51ab5556a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:03.730822 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d6300ca5-ae3f-4475-925d-dff51ab5556a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:03.731261 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d6300ca5-ae3f-4475-925d-dff51ab5556a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:03.759135 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.objects.instance [None req-d6300ca5-ae3f-4475-925d-dff51ab5556a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lazy-loading 'flavor' on Instance uuid 6a780ece-54a3-4348-a484-8cc1fd983934 {{(pid=124267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:47:03.949885 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-d6300ca5-ae3f-4475-925d-dff51ab5556a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "POST /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934/action" status: 200 len: 32 microversion: 2.1 time: 0.233228 May 26 16:47:03.950500 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 305/612] 10.222.0.102 () {60 vars in 1282 bytes} [Thu May 26 16:47:03 2022] POST /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934/action => generated 32 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 16:47:03.959543 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f3f46c75-3493-4ae0-b986-639f245efb47 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:03.960158 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f3f46c75-3493-4ae0-b986-639f245efb47 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:03.967160 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f3f46c75-3493-4ae0-b986-639f245efb47 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:03.967643 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f3f46c75-3493-4ae0-b986-639f245efb47 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:03.968488 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f3f46c75-3493-4ae0-b986-639f245efb47 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:03.968928 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f3f46c75-3493-4ae0-b986-639f245efb47 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:04.117873 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f3f46c75-3493-4ae0-b986-639f245efb47 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:04.126444 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f3f46c75-3493-4ae0-b986-639f245efb47 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1737 microversion: 2.1 time: 0.170713 May 26 16:47:04.127027 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 308/613] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:03 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:05.146425 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-66638440-8ddc-4114-9d94-b8107b8a3a80 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:05.147211 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-66638440-8ddc-4114-9d94-b8107b8a3a80 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:05.154548 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-66638440-8ddc-4114-9d94-b8107b8a3a80 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:05.155001 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-66638440-8ddc-4114-9d94-b8107b8a3a80 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:05.155789 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-66638440-8ddc-4114-9d94-b8107b8a3a80 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:05.156260 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-66638440-8ddc-4114-9d94-b8107b8a3a80 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:05.322388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-66638440-8ddc-4114-9d94-b8107b8a3a80 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:05.337480 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-66638440-8ddc-4114-9d94-b8107b8a3a80 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1737 microversion: 2.1 time: 0.196048 May 26 16:47:05.338537 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 306/614] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:05 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1737 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:06.361988 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-de3407f0-3f17-4b8b-95cf-6ccfec8abd28 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:06.362595 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-de3407f0-3f17-4b8b-95cf-6ccfec8abd28 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:06.369231 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-de3407f0-3f17-4b8b-95cf-6ccfec8abd28 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:06.369682 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-de3407f0-3f17-4b8b-95cf-6ccfec8abd28 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:06.370432 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-de3407f0-3f17-4b8b-95cf-6ccfec8abd28 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:06.370863 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-de3407f0-3f17-4b8b-95cf-6ccfec8abd28 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:06.504333 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-de3407f0-3f17-4b8b-95cf-6ccfec8abd28 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:06.512603 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-de3407f0-3f17-4b8b-95cf-6ccfec8abd28 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1737 microversion: 2.1 time: 0.154271 May 26 16:47:06.513189 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 309/615] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:06 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:07.530437 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-43f60945-9a30-4b03-a9dc-f1259f847966 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:07.531067 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-43f60945-9a30-4b03-a9dc-f1259f847966 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:07.538226 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-43f60945-9a30-4b03-a9dc-f1259f847966 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:07.538680 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-43f60945-9a30-4b03-a9dc-f1259f847966 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:07.539453 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-43f60945-9a30-4b03-a9dc-f1259f847966 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:07.539894 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-43f60945-9a30-4b03-a9dc-f1259f847966 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:07.680901 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-43f60945-9a30-4b03-a9dc-f1259f847966 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:07.689549 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-43f60945-9a30-4b03-a9dc-f1259f847966 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1737 microversion: 2.1 time: 0.162935 May 26 16:47:07.690138 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 307/616] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:07 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:08.707534 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7d766a18-1a12-4823-a82e-20aa97f99651 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:08.708138 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-7d766a18-1a12-4823-a82e-20aa97f99651 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:08.714882 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7d766a18-1a12-4823-a82e-20aa97f99651 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:08.715329 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7d766a18-1a12-4823-a82e-20aa97f99651 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:08.716101 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7d766a18-1a12-4823-a82e-20aa97f99651 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:08.716575 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7d766a18-1a12-4823-a82e-20aa97f99651 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:08.845444 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7d766a18-1a12-4823-a82e-20aa97f99651 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:08.854065 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7d766a18-1a12-4823-a82e-20aa97f99651 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1737 microversion: 2.1 time: 0.150432 May 26 16:47:08.854638 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 310/617] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:08 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:09.871655 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-9480bdc3-b2d9-437a-8569-dfef5c2f1c89 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:09.872191 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-9480bdc3-b2d9-437a-8569-dfef5c2f1c89 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:09.878626 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9480bdc3-b2d9-437a-8569-dfef5c2f1c89 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:09.879060 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9480bdc3-b2d9-437a-8569-dfef5c2f1c89 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:09.879843 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9480bdc3-b2d9-437a-8569-dfef5c2f1c89 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:09.880283 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9480bdc3-b2d9-437a-8569-dfef5c2f1c89 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:10.013070 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-9480bdc3-b2d9-437a-8569-dfef5c2f1c89 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:10.021774 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-9480bdc3-b2d9-437a-8569-dfef5c2f1c89 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1737 microversion: 2.1 time: 0.154045 May 26 16:47:10.022356 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 308/618] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:09 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:11.039638 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ff176d50-1bdc-4022-814b-5305a5a81343 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:11.040217 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ff176d50-1bdc-4022-814b-5305a5a81343 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:11.047142 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ff176d50-1bdc-4022-814b-5305a5a81343 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:11.047596 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ff176d50-1bdc-4022-814b-5305a5a81343 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:11.048389 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ff176d50-1bdc-4022-814b-5305a5a81343 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:11.048827 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ff176d50-1bdc-4022-814b-5305a5a81343 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:11.222702 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ff176d50-1bdc-4022-814b-5305a5a81343 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:11.238449 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ff176d50-1bdc-4022-814b-5305a5a81343 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1737 microversion: 2.1 time: 0.202778 May 26 16:47:11.240096 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 311/619] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:11 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1737 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:12.264174 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-1077e40d-13dd-4523-a492-02081420d48a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:12.264820 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-1077e40d-13dd-4523-a492-02081420d48a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:12.266924 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_api:SELECT=30 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:12.272340 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1077e40d-13dd-4523-a492-02081420d48a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:12.272812 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1077e40d-13dd-4523-a492-02081420d48a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:12.273591 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1077e40d-13dd-4523-a492-02081420d48a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:12.274022 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1077e40d-13dd-4523-a492-02081420d48a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:12.417785 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-1077e40d-13dd-4523-a492-02081420d48a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:12.426024 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-1077e40d-13dd-4523-a492-02081420d48a tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1737 microversion: 2.1 time: 0.165869 May 26 16:47:12.427144 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 309/620] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:12 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:13.443731 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ae2c0e71-77a6-47db-ae6a-f3b1fe3768e5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:13.444318 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ae2c0e71-77a6-47db-ae6a-f3b1fe3768e5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:13.447055 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=28 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:13.452483 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ae2c0e71-77a6-47db-ae6a-f3b1fe3768e5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:13.452947 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ae2c0e71-77a6-47db-ae6a-f3b1fe3768e5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:13.453689 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ae2c0e71-77a6-47db-ae6a-f3b1fe3768e5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:13.454122 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ae2c0e71-77a6-47db-ae6a-f3b1fe3768e5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:13.586866 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ae2c0e71-77a6-47db-ae6a-f3b1fe3768e5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:13.594877 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ae2c0e71-77a6-47db-ae6a-f3b1fe3768e5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1737 microversion: 2.1 time: 0.155059 May 26 16:47:13.595458 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 312/621] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:13 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:14.613251 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-de9d7a80-2809-460a-9561-c239bfb5eb6c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:14.613895 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-de9d7a80-2809-460a-9561-c239bfb5eb6c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:14.621484 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-de9d7a80-2809-460a-9561-c239bfb5eb6c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:14.621933 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-de9d7a80-2809-460a-9561-c239bfb5eb6c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:14.622780 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-de9d7a80-2809-460a-9561-c239bfb5eb6c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:14.623249 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-de9d7a80-2809-460a-9561-c239bfb5eb6c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:14.757531 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-de9d7a80-2809-460a-9561-c239bfb5eb6c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:14.765652 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-de9d7a80-2809-460a-9561-c239bfb5eb6c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1737 microversion: 2.1 time: 0.156232 May 26 16:47:14.766217 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 310/622] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:14 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:15.782204 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-03be37ef-806b-4dab-b2a5-52a83f20e8d6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:15.782809 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-03be37ef-806b-4dab-b2a5-52a83f20e8d6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:15.789273 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-03be37ef-806b-4dab-b2a5-52a83f20e8d6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:15.789720 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-03be37ef-806b-4dab-b2a5-52a83f20e8d6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:15.790502 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-03be37ef-806b-4dab-b2a5-52a83f20e8d6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:15.791082 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-03be37ef-806b-4dab-b2a5-52a83f20e8d6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:15.921885 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-03be37ef-806b-4dab-b2a5-52a83f20e8d6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:15.930451 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-03be37ef-806b-4dab-b2a5-52a83f20e8d6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1737 microversion: 2.1 time: 0.152048 May 26 16:47:15.931020 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 313/623] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:15 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:16.947894 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-1603a3c3-d3d6-4c4a-9170-5a104e74c2c2 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:16.948669 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-1603a3c3-d3d6-4c4a-9170-5a104e74c2c2 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:16.955169 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1603a3c3-d3d6-4c4a-9170-5a104e74c2c2 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:16.955618 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1603a3c3-d3d6-4c4a-9170-5a104e74c2c2 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:16.956412 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1603a3c3-d3d6-4c4a-9170-5a104e74c2c2 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:16.956855 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1603a3c3-d3d6-4c4a-9170-5a104e74c2c2 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:17.084493 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-1603a3c3-d3d6-4c4a-9170-5a104e74c2c2 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:17.092818 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-1603a3c3-d3d6-4c4a-9170-5a104e74c2c2 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1737 microversion: 2.1 time: 0.149002 May 26 16:47:17.093581 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 311/624] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:16 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:18.110657 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ff7d0643-d26b-4240-ac8f-67ef1397d6f6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:18.111252 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ff7d0643-d26b-4240-ac8f-67ef1397d6f6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:18.117752 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ff7d0643-d26b-4240-ac8f-67ef1397d6f6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:18.118194 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ff7d0643-d26b-4240-ac8f-67ef1397d6f6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:18.119096 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ff7d0643-d26b-4240-ac8f-67ef1397d6f6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:18.119510 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ff7d0643-d26b-4240-ac8f-67ef1397d6f6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:18.258237 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ff7d0643-d26b-4240-ac8f-67ef1397d6f6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:18.266280 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ff7d0643-d26b-4240-ac8f-67ef1397d6f6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1737 microversion: 2.1 time: 0.159440 May 26 16:47:18.266849 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 314/625] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:18 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:19.285536 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-0d9d6488-e538-419d-9cd0-18bfba6ae0ff tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:19.286731 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-0d9d6488-e538-419d-9cd0-18bfba6ae0ff tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:19.293755 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0d9d6488-e538-419d-9cd0-18bfba6ae0ff tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:19.294247 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0d9d6488-e538-419d-9cd0-18bfba6ae0ff tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:19.295044 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0d9d6488-e538-419d-9cd0-18bfba6ae0ff tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:19.295475 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0d9d6488-e538-419d-9cd0-18bfba6ae0ff tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:19.452515 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-0d9d6488-e538-419d-9cd0-18bfba6ae0ff tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:19.461484 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-0d9d6488-e538-419d-9cd0-18bfba6ae0ff tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1737 microversion: 2.1 time: 0.179853 May 26 16:47:19.462081 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 312/626] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:19 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1737 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:20.479680 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-db452faa-f014-476d-8ab4-f5b144d17560 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:20.480321 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-db452faa-f014-476d-8ab4-f5b144d17560 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:20.487369 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-db452faa-f014-476d-8ab4-f5b144d17560 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:20.487824 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-db452faa-f014-476d-8ab4-f5b144d17560 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:20.488635 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-db452faa-f014-476d-8ab4-f5b144d17560 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:20.489655 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-db452faa-f014-476d-8ab4-f5b144d17560 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:20.626110 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-db452faa-f014-476d-8ab4-f5b144d17560 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:20.635317 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-db452faa-f014-476d-8ab4-f5b144d17560 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1737 microversion: 2.1 time: 0.158999 May 26 16:47:20.635741 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 315/627] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:20 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:21.657962 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-af7a1123-614b-4892-9368-1331a8df5c8e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:21.658605 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-af7a1123-614b-4892-9368-1331a8df5c8e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:21.665190 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-af7a1123-614b-4892-9368-1331a8df5c8e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:21.665638 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-af7a1123-614b-4892-9368-1331a8df5c8e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:21.666502 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-af7a1123-614b-4892-9368-1331a8df5c8e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:21.667033 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-af7a1123-614b-4892-9368-1331a8df5c8e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:21.800877 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-af7a1123-614b-4892-9368-1331a8df5c8e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:21.809454 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-af7a1123-614b-4892-9368-1331a8df5c8e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1737 microversion: 2.1 time: 0.155335 May 26 16:47:21.810062 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 313/628] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:21 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:22.828800 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-823dc7a2-2ec4-47af-be4f-d395abf3633b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:22.829677 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-823dc7a2-2ec4-47af-be4f-d395abf3633b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:22.838193 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-823dc7a2-2ec4-47af-be4f-d395abf3633b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:22.838616 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-823dc7a2-2ec4-47af-be4f-d395abf3633b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:22.839449 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-823dc7a2-2ec4-47af-be4f-d395abf3633b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:22.839943 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-823dc7a2-2ec4-47af-be4f-d395abf3633b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:22.989655 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-823dc7a2-2ec4-47af-be4f-d395abf3633b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:22.998492 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-823dc7a2-2ec4-47af-be4f-d395abf3633b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1737 microversion: 2.1 time: 0.174650 May 26 16:47:22.999094 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 316/629] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:22 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:24.016860 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-03869024-ae8f-4d45-8165-cb4c0ace106f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:24.017457 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-03869024-ae8f-4d45-8165-cb4c0ace106f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:24.024517 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-03869024-ae8f-4d45-8165-cb4c0ace106f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:24.024967 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-03869024-ae8f-4d45-8165-cb4c0ace106f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:24.025737 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-03869024-ae8f-4d45-8165-cb4c0ace106f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:24.026168 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-03869024-ae8f-4d45-8165-cb4c0ace106f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:24.157351 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-03869024-ae8f-4d45-8165-cb4c0ace106f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:24.165914 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-03869024-ae8f-4d45-8165-cb4c0ace106f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1737 microversion: 2.1 time: 0.152844 May 26 16:47:24.166505 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 314/630] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:24 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:25.183381 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1f281c7e-d58c-41dc-ae46-cacae794814c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:25.184107 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1f281c7e-d58c-41dc-ae46-cacae794814c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:25.190650 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1f281c7e-d58c-41dc-ae46-cacae794814c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:25.191111 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1f281c7e-d58c-41dc-ae46-cacae794814c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:25.191880 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1f281c7e-d58c-41dc-ae46-cacae794814c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:25.192325 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1f281c7e-d58c-41dc-ae46-cacae794814c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:25.331777 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1f281c7e-d58c-41dc-ae46-cacae794814c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:25.340363 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1f281c7e-d58c-41dc-ae46-cacae794814c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1717 microversion: 2.1 time: 0.160763 May 26 16:47:25.340947 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 317/631] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:25 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1717 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:25.396689 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-5e6aee1e-1a38-457c-80cb-3c710eae2ade tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:25.397190 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-5e6aee1e-1a38-457c-80cb-3c710eae2ade tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:25.403557 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-5e6aee1e-1a38-457c-80cb-3c710eae2ade tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:25.404037 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-5e6aee1e-1a38-457c-80cb-3c710eae2ade tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:25.404836 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-5e6aee1e-1a38-457c-80cb-3c710eae2ade tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:25.405269 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-5e6aee1e-1a38-457c-80cb-3c710eae2ade tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:25.530910 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.wsgi [None req-5e6aee1e-1a38-457c-80cb-3c710eae2ade tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] HTTP exception thrown: Cannot 'detach_volume' instance 6a780ece-54a3-4348-a484-8cc1fd983934 while it is in vm_state rescued May 26 16:47:25.532539 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-5e6aee1e-1a38-457c-80cb-3c710eae2ade tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Request method failure captured: May 26 16:47:25.532539 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: request: DELETE /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934/os-volume_attachments/0f7cea50-f290-429b-b903-b729aed245c2 HTTP/1.1 May 26 16:47:25.532539 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept: application/json May 26 16:47:25.532539 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept-Encoding: identity May 26 16:47:25.532539 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Connection: close May 26 16:47:25.532539 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Length: 0 May 26 16:47:25.532539 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Type: application/json May 26 16:47:25.532539 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Host: 10.222.0.102 May 26 16:47:25.532539 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Openstack-System-Scope: None May 26 16:47:25.532539 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: User-Agent: python-urllib3/1.26.9 May 26 16:47:25.532539 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Auth-Token: gAAAAABij62o9giAUjK9QPbUFbwFo-FgFlOy7dIdimEDaohYi-sKTCdB1x5HtixELEAzUkpBuerDG9JUdHvExIjWA4U-cGIqZbLgDVo_-1KrAr5aGX22qLivGdFGb8QTOdP7EHcYJDUTZmj-LaOBh6ZTeQxUKquK1A4-AFQYG9aL6_6JaqjZXrQ May 26 16:47:25.532539 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Id: None May 26 16:47:25.532539 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Name: None May 26 16:47:25.532539 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Identity-Status: Confirmed May 26 16:47:25.532539 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Is-Admin-Project: True May 26 16:47:25.532539 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Id: default May 26 16:47:25.532539 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Name: Default May 26 16:47:25.532539 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Id: a85ded3a20964dbbbc354199f5129d9b May 26 16:47:25.532539 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1592668870 May 26 16:47:25.532539 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Role: reader,member May 26 16:47:25.532539 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Roles: reader,member May 26 16:47:25.534128 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/a85ded3a20964dbbbc354199f5129d9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/a85ded3a20964dbbbc354199f5129d9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/a85ded3a20964dbbbc354199f5129d9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_a85ded3a20964dbbbc354199f5129d9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:47:25.534128 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1592668870 May 26 16:47:25.534128 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Id: a85ded3a20964dbbbc354199f5129d9b May 26 16:47:25.534128 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1592668870 May 26 16:47:25.534128 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User: tempest-ServerRescueNegativeTestJSON-1592668870-project May 26 16:47:25.534128 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Id: default May 26 16:47:25.534128 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Name: Default May 26 16:47:25.534128 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Id: 9330e65e73394f18b87c5b1d5d47f564 May 26 16:47:25.534128 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1592668870-project May 26 16:47:25.534128 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: method: > May 26 16:47:25.534128 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: exception: Cannot 'detach_volume' instance 6a780ece-54a3-4348-a484-8cc1fd983934 while it is in vm_state rescued May 26 16:47:25.534888 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: action_args: {'server_id': '6a780ece-54a3-4348-a484-8cc1fd983934', 'id': '0f7cea50-f290-429b-b903-b729aed245c2'} May 26 16:47:25.534888 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:47:25.534888 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:47:25.534888 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 16:47:25.534888 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 16:47:25.534888 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 16:47:25.534888 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 16:47:25.534888 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 26 16:47:25.534888 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 26 16:47:25.534888 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6a780ece-54a3-4348-a484-8cc1fd983934 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 26 16:47:25.534888 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:47:25.534888 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:47:25.534888 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:47:25.534888 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:47:25.534888 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:47:25.534888 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:47:25.534888 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:47:25.534888 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:47:25.534888 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:47:25.534888 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:47:25.536922 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 26 16:47:25.536922 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 26 16:47:25.536922 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 26 16:47:25.536922 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 26 16:47:25.536922 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 6a780ece-54a3-4348-a484-8cc1fd983934 while it is in vm_state rescued May 26 16:47:25.536922 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:47:25.536922 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:47:25.536922 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:47:25.536922 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:47:25.536922 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:47:25.536922 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:47:25.536922 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:47:25.536922 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:47:25.536922 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 6a780ece-54a3-4348-a484-8cc1fd983934 while it is in vm_state rescued May 26 16:47:25.536922 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:47:25.536922 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-5e6aee1e-1a38-457c-80cb-3c710eae2ade tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Returning 409 to user: Cannot 'detach_volume' instance 6a780ece-54a3-4348-a484-8cc1fd983934 while it is in vm_state rescued {{(pid=124267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:47:25.538395 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-5e6aee1e-1a38-457c-80cb-3c710eae2ade tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "DELETE /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934/os-volume_attachments/0f7cea50-f290-429b-b903-b729aed245c2" status: 409 len: 152 microversion: 2.1 time: 0.141773 May 26 16:47:25.538395 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 315/632] 10.222.0.102 () {58 vars in 1420 bytes} [Thu May 26 16:47:25 2022] DELETE /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934/os-volume_attachments/0f7cea50-f290-429b-b903-b729aed245c2 => generated 152 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 26 16:47:25.543997 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-543ec126-eca0-49e6-99f5-10f0ec07320c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:47:25.544565 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-543ec126-eca0-49e6-99f5-10f0ec07320c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:25.550543 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-543ec126-eca0-49e6-99f5-10f0ec07320c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:25.550984 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-543ec126-eca0-49e6-99f5-10f0ec07320c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:25.551737 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-543ec126-eca0-49e6-99f5-10f0ec07320c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:25.552170 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-543ec126-eca0-49e6-99f5-10f0ec07320c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:25.623707 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-543ec126-eca0-49e6-99f5-10f0ec07320c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "POST /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934/action" status: 202 len: 0 microversion: 2.1 time: 0.083503 May 26 16:47:25.628088 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 318/633] 10.222.0.102 () {60 vars in 1282 bytes} [Thu May 26 16:47:25 2022] POST /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 16:47:25.634246 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-b5ed8c9f-8796-4a88-a403-7509610973c3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:25.634857 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-b5ed8c9f-8796-4a88-a403-7509610973c3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:25.644183 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b5ed8c9f-8796-4a88-a403-7509610973c3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:25.645419 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b5ed8c9f-8796-4a88-a403-7509610973c3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:25.646818 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b5ed8c9f-8796-4a88-a403-7509610973c3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:25.647584 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b5ed8c9f-8796-4a88-a403-7509610973c3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:25.791189 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-b5ed8c9f-8796-4a88-a403-7509610973c3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:25.799504 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-b5ed8c9f-8796-4a88-a403-7509610973c3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1725 microversion: 2.1 time: 0.169330 May 26 16:47:25.800081 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 316/634] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:25 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:47:26.818362 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0532884e-28a0-49c3-8ea4-f2358e3b18b6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:26.819069 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0532884e-28a0-49c3-8ea4-f2358e3b18b6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:26.826277 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0532884e-28a0-49c3-8ea4-f2358e3b18b6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:26.826737 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0532884e-28a0-49c3-8ea4-f2358e3b18b6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:26.827527 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0532884e-28a0-49c3-8ea4-f2358e3b18b6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:26.827968 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0532884e-28a0-49c3-8ea4-f2358e3b18b6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:26.830893 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:26.973793 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0532884e-28a0-49c3-8ea4-f2358e3b18b6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:26.981911 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0532884e-28a0-49c3-8ea4-f2358e3b18b6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1725 microversion: 2.1 time: 0.167804 May 26 16:47:26.982486 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 319/635] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:26 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:27.999925 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-e65e7530-3f85-4e93-a900-6910b4aabb6b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:28.000904 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-e65e7530-3f85-4e93-a900-6910b4aabb6b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:28.008120 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e65e7530-3f85-4e93-a900-6910b4aabb6b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:28.008608 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e65e7530-3f85-4e93-a900-6910b4aabb6b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:28.009388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e65e7530-3f85-4e93-a900-6910b4aabb6b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:28.009830 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e65e7530-3f85-4e93-a900-6910b4aabb6b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:28.146890 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-e65e7530-3f85-4e93-a900-6910b4aabb6b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:28.155516 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-e65e7530-3f85-4e93-a900-6910b4aabb6b tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1725 microversion: 2.1 time: 0.160083 May 26 16:47:28.156107 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 317/636] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:27 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:29.173378 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-141b89fe-60a9-4f27-93df-7d1654de69cf tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:29.174099 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-141b89fe-60a9-4f27-93df-7d1654de69cf tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:29.182449 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-141b89fe-60a9-4f27-93df-7d1654de69cf tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:29.182902 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-141b89fe-60a9-4f27-93df-7d1654de69cf tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:29.184204 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-141b89fe-60a9-4f27-93df-7d1654de69cf tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:29.184204 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-141b89fe-60a9-4f27-93df-7d1654de69cf tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:29.330881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-141b89fe-60a9-4f27-93df-7d1654de69cf tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:29.339392 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-141b89fe-60a9-4f27-93df-7d1654de69cf tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1725 microversion: 2.1 time: 0.169923 May 26 16:47:29.339968 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 320/637] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:29 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:30.357114 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-ed6855b3-f2da-4c49-b3da-391389c0ec80 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:30.357754 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-ed6855b3-f2da-4c49-b3da-391389c0ec80 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:30.364694 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ed6855b3-f2da-4c49-b3da-391389c0ec80 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:30.365031 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ed6855b3-f2da-4c49-b3da-391389c0ec80 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:30.365814 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ed6855b3-f2da-4c49-b3da-391389c0ec80 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:30.366248 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ed6855b3-f2da-4c49-b3da-391389c0ec80 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:30.520863 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-ed6855b3-f2da-4c49-b3da-391389c0ec80 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:30.529142 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-ed6855b3-f2da-4c49-b3da-391389c0ec80 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1731 microversion: 2.1 time: 0.176037 May 26 16:47:30.529736 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 318/638] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:30 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:47:30.547525 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d8fc5964-9db6-40c2-8904-d1c781412ee8 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:30.548183 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d8fc5964-9db6-40c2-8904-d1c781412ee8 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:30.555492 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d8fc5964-9db6-40c2-8904-d1c781412ee8 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:30.555947 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d8fc5964-9db6-40c2-8904-d1c781412ee8 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:30.556766 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d8fc5964-9db6-40c2-8904-d1c781412ee8 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:30.557211 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d8fc5964-9db6-40c2-8904-d1c781412ee8 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:30.642878 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d8fc5964-9db6-40c2-8904-d1c781412ee8 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099925 May 26 16:47:30.643866 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 321/639] 10.222.0.102 () {58 vars in 1279 bytes} [Thu May 26 16:47:30 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:47:31.627511 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-25c54edf-9cd2-4af5-8000-e568b7a0a803 req-e87b8847-af26-4ea5-9823-214c6522fcd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a780ece-54a3-4348-a484-8cc1fd983934", "tag": "f73f919a-97c7-4339-b316-1192335f4fa0"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:47:31.637575 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-25c54edf-9cd2-4af5-8000-e568b7a0a803 req-e87b8847-af26-4ea5-9823-214c6522fcd7 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:31.638121 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-25c54edf-9cd2-4af5-8000-e568b7a0a803 req-e87b8847-af26-4ea5-9823-214c6522fcd7 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:31.642452 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:31.651760 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-25c54edf-9cd2-4af5-8000-e568b7a0a803 req-e87b8847-af26-4ea5-9823-214c6522fcd7 service nova] Creating event network-changed:f73f919a-97c7-4339-b316-1192335f4fa0 for instance 6a780ece-54a3-4348-a484-8cc1fd983934 on hv-cinder-83607 May 26 16:47:31.656998 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-25c54edf-9cd2-4af5-8000-e568b7a0a803 req-e87b8847-af26-4ea5-9823-214c6522fcd7 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103196 May 26 16:47:31.657582 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 319/640] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:47:33.492132 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ce25399e-7e8a-4457-aeb6-fd9003232fc8 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:47:33.493179 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ce25399e-7e8a-4457-aeb6-fd9003232fc8 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:33.499910 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ce25399e-7e8a-4457-aeb6-fd9003232fc8 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:33.500354 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ce25399e-7e8a-4457-aeb6-fd9003232fc8 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:33.501149 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ce25399e-7e8a-4457-aeb6-fd9003232fc8 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:33.501584 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ce25399e-7e8a-4457-aeb6-fd9003232fc8 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:33.577312 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ce25399e-7e8a-4457-aeb6-fd9003232fc8 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "POST /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8/action" status: 202 len: 0 microversion: 2.1 time: 0.090135 May 26 16:47:33.577875 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 322/641] 10.222.0.102 () {60 vars in 1282 bytes} [Thu May 26 16:47:33 2022] POST /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 16:47:33.588332 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-06f8d30f-31bb-44de-825d-9566e76292c6 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:33.589159 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-06f8d30f-31bb-44de-825d-9566e76292c6 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:33.595976 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-06f8d30f-31bb-44de-825d-9566e76292c6 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:33.596593 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-06f8d30f-31bb-44de-825d-9566e76292c6 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:33.597376 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-06f8d30f-31bb-44de-825d-9566e76292c6 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:33.598582 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-06f8d30f-31bb-44de-825d-9566e76292c6 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:33.672202 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-768b6be4-1bfc-4b34-a62f-d4c96a9ceed9 req-fbc99971-365a-4781-8b55-0d048a7a215e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a780ece-54a3-4348-a484-8cc1fd983934", "tag": "f73f919a-97c7-4339-b316-1192335f4fa0"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:47:33.681355 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-768b6be4-1bfc-4b34-a62f-d4c96a9ceed9 req-fbc99971-365a-4781-8b55-0d048a7a215e service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:33.682231 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-768b6be4-1bfc-4b34-a62f-d4c96a9ceed9 req-fbc99971-365a-4781-8b55-0d048a7a215e service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:33.697850 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-768b6be4-1bfc-4b34-a62f-d4c96a9ceed9 req-fbc99971-365a-4781-8b55-0d048a7a215e service nova] Creating event network-changed:f73f919a-97c7-4339-b316-1192335f4fa0 for instance 6a780ece-54a3-4348-a484-8cc1fd983934 on hv-cinder-83607 May 26 16:47:33.707460 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-768b6be4-1bfc-4b34-a62f-d4c96a9ceed9 req-fbc99971-365a-4781-8b55-0d048a7a215e service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038375 May 26 16:47:33.708751 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 323/642] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:47:33.762472 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-06f8d30f-31bb-44de-825d-9566e76292c6 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:33.773903 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-06f8d30f-31bb-44de-825d-9566e76292c6 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1755 microversion: 2.1 time: 0.190768 May 26 16:47:33.774837 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 320/643] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:33 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1755 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:34.792556 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-068192f7-6371-4cc3-89bf-c63159d0b403 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:34.793415 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-068192f7-6371-4cc3-89bf-c63159d0b403 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:34.800696 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-068192f7-6371-4cc3-89bf-c63159d0b403 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:34.801679 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-068192f7-6371-4cc3-89bf-c63159d0b403 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:34.802469 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-068192f7-6371-4cc3-89bf-c63159d0b403 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:34.802909 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-068192f7-6371-4cc3-89bf-c63159d0b403 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:34.974392 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-068192f7-6371-4cc3-89bf-c63159d0b403 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:34.985626 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-068192f7-6371-4cc3-89bf-c63159d0b403 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1760 microversion: 2.1 time: 0.197308 May 26 16:47:34.986543 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 324/644] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:34 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1760 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:36.005501 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-c7fc4be7-867c-40a7-8401-e986a02ce2f3 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:36.006093 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-c7fc4be7-867c-40a7-8401-e986a02ce2f3 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:36.013196 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c7fc4be7-867c-40a7-8401-e986a02ce2f3 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:36.013650 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c7fc4be7-867c-40a7-8401-e986a02ce2f3 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:36.014453 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c7fc4be7-867c-40a7-8401-e986a02ce2f3 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:36.014895 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c7fc4be7-867c-40a7-8401-e986a02ce2f3 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:36.177544 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-c7fc4be7-867c-40a7-8401-e986a02ce2f3 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:36.186685 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-c7fc4be7-867c-40a7-8401-e986a02ce2f3 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1760 microversion: 2.1 time: 0.185550 May 26 16:47:36.187369 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 321/645] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:35 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1760 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:37.211791 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-26a2962f-f4e6-48fe-a043-a481b7a3940d tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:37.212657 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-26a2962f-f4e6-48fe-a043-a481b7a3940d tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:37.219444 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-26a2962f-f4e6-48fe-a043-a481b7a3940d tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:37.219904 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-26a2962f-f4e6-48fe-a043-a481b7a3940d tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:37.220731 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-26a2962f-f4e6-48fe-a043-a481b7a3940d tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:37.221168 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-26a2962f-f4e6-48fe-a043-a481b7a3940d tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:37.381008 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-26a2962f-f4e6-48fe-a043-a481b7a3940d tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:37.390012 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-26a2962f-f4e6-48fe-a043-a481b7a3940d tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1760 microversion: 2.1 time: 0.182259 May 26 16:47:37.390621 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 325/646] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:37 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1760 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:47:38.408093 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-a838c176-e22a-4401-99fc-58788379b759 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:38.408847 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-a838c176-e22a-4401-99fc-58788379b759 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:38.416086 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a838c176-e22a-4401-99fc-58788379b759 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:38.416576 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a838c176-e22a-4401-99fc-58788379b759 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:38.417356 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a838c176-e22a-4401-99fc-58788379b759 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:38.417795 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a838c176-e22a-4401-99fc-58788379b759 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:38.606712 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-a838c176-e22a-4401-99fc-58788379b759 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:38.615864 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-a838c176-e22a-4401-99fc-58788379b759 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1760 microversion: 2.1 time: 0.211644 May 26 16:47:38.616487 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 322/647] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:38 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1760 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:39.634550 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1a5af5fa-a53b-4ef8-8b83-410d41a3ac78 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:39.635358 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1a5af5fa-a53b-4ef8-8b83-410d41a3ac78 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:39.642339 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1a5af5fa-a53b-4ef8-8b83-410d41a3ac78 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:39.642794 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1a5af5fa-a53b-4ef8-8b83-410d41a3ac78 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:39.643578 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1a5af5fa-a53b-4ef8-8b83-410d41a3ac78 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:39.644016 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1a5af5fa-a53b-4ef8-8b83-410d41a3ac78 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:39.817752 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1a5af5fa-a53b-4ef8-8b83-410d41a3ac78 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:39.827363 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1a5af5fa-a53b-4ef8-8b83-410d41a3ac78 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1760 microversion: 2.1 time: 0.197141 May 26 16:47:39.827963 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 326/648] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:39 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1760 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:40.846156 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-428043a5-3b18-448a-886d-23d7584e497e tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:40.849913 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-428043a5-3b18-448a-886d-23d7584e497e tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:40.854144 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-428043a5-3b18-448a-886d-23d7584e497e tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:40.854595 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-428043a5-3b18-448a-886d-23d7584e497e tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:40.855384 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-428043a5-3b18-448a-886d-23d7584e497e tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:40.855825 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-428043a5-3b18-448a-886d-23d7584e497e tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:41.010643 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-428043a5-3b18-448a-886d-23d7584e497e tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:41.020000 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-428043a5-3b18-448a-886d-23d7584e497e tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1760 microversion: 2.1 time: 0.178516 May 26 16:47:41.020630 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 323/649] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:40 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1760 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:42.037846 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0db4c4bb-36d1-4958-b60a-3f7a3df300b4 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:42.038514 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0db4c4bb-36d1-4958-b60a-3f7a3df300b4 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:42.045080 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0db4c4bb-36d1-4958-b60a-3f7a3df300b4 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:42.045529 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0db4c4bb-36d1-4958-b60a-3f7a3df300b4 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:42.046302 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0db4c4bb-36d1-4958-b60a-3f7a3df300b4 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:42.046740 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0db4c4bb-36d1-4958-b60a-3f7a3df300b4 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:42.191263 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0db4c4bb-36d1-4958-b60a-3f7a3df300b4 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:42.200086 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0db4c4bb-36d1-4958-b60a-3f7a3df300b4 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1760 microversion: 2.1 time: 0.166667 May 26 16:47:42.200705 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 327/650] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:42 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1760 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:43.218060 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-f59ddd33-7dde-4cd9-964a-744d6845e924 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:43.218726 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-f59ddd33-7dde-4cd9-964a-744d6845e924 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:43.220803 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_api:SELECT=30 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:43.226859 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f59ddd33-7dde-4cd9-964a-744d6845e924 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:43.227698 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f59ddd33-7dde-4cd9-964a-744d6845e924 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:43.228074 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f59ddd33-7dde-4cd9-964a-744d6845e924 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:43.228546 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f59ddd33-7dde-4cd9-964a-744d6845e924 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:43.378773 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-f59ddd33-7dde-4cd9-964a-744d6845e924 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:43.387329 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-f59ddd33-7dde-4cd9-964a-744d6845e924 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1760 microversion: 2.1 time: 0.173367 May 26 16:47:43.387923 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 324/651] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:43 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1760 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:44.405575 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-c3807276-8d11-4654-9b91-1d095cf2c609 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:44.406187 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-c3807276-8d11-4654-9b91-1d095cf2c609 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:44.408852 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=32 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:44.414364 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c3807276-8d11-4654-9b91-1d095cf2c609 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:44.414811 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c3807276-8d11-4654-9b91-1d095cf2c609 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:44.415675 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c3807276-8d11-4654-9b91-1d095cf2c609 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:44.416113 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c3807276-8d11-4654-9b91-1d095cf2c609 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:44.567284 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c3807276-8d11-4654-9b91-1d095cf2c609 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:44.575694 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-c3807276-8d11-4654-9b91-1d095cf2c609 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1760 microversion: 2.1 time: 0.174046 May 26 16:47:44.576297 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 328/652] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:44 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1760 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:47:45.041403 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-c60ee41e-7c8e-4a52-90ef-1666b86bca32 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:45.041981 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-c60ee41e-7c8e-4a52-90ef-1666b86bca32 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:45.048052 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c60ee41e-7c8e-4a52-90ef-1666b86bca32 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:45.048530 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c60ee41e-7c8e-4a52-90ef-1666b86bca32 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:45.049313 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c60ee41e-7c8e-4a52-90ef-1666b86bca32 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:45.049741 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c60ee41e-7c8e-4a52-90ef-1666b86bca32 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:45.133137 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.objects.instance [None req-c60ee41e-7c8e-4a52-90ef-1666b86bca32 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lazy-loading 'services' on Instance uuid 15756f2d-4f17-4b50-b02e-4cf50051ec29 {{(pid=124267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:47:45.249318 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-c60ee41e-7c8e-4a52-90ef-1666b86bca32 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "DELETE /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29/os-volume_attachments/5a6d062d-8da6-4044-85aa-50c4b68bc67d" status: 202 len: 0 microversion: 2.1 time: 0.329698 May 26 16:47:45.249983 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 325/653] 10.222.0.102 () {58 vars in 1420 bytes} [Thu May 26 16:47:44 2022] DELETE /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29/os-volume_attachments/5a6d062d-8da6-4044-85aa-50c4b68bc67d => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 16:47:45.592536 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-fc86a386-3df7-4146-8ca3-8f97ae00da19 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:45.593142 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-fc86a386-3df7-4146-8ca3-8f97ae00da19 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:45.600400 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fc86a386-3df7-4146-8ca3-8f97ae00da19 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:45.600851 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fc86a386-3df7-4146-8ca3-8f97ae00da19 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:45.601606 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fc86a386-3df7-4146-8ca3-8f97ae00da19 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:45.602036 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fc86a386-3df7-4146-8ca3-8f97ae00da19 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:45.746072 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-fc86a386-3df7-4146-8ca3-8f97ae00da19 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:45.753998 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-fc86a386-3df7-4146-8ca3-8f97ae00da19 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1760 microversion: 2.1 time: 0.165323 May 26 16:47:45.754557 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 329/654] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:45 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1760 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:46.771410 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-af699b9b-0359-4b16-bcb4-f4bb8d00fb74 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:46.772309 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-af699b9b-0359-4b16-bcb4-f4bb8d00fb74 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:46.779529 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-af699b9b-0359-4b16-bcb4-f4bb8d00fb74 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:46.780001 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-af699b9b-0359-4b16-bcb4-f4bb8d00fb74 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:46.782068 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-af699b9b-0359-4b16-bcb4-f4bb8d00fb74 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:46.782612 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-af699b9b-0359-4b16-bcb4-f4bb8d00fb74 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:46.929086 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-af699b9b-0359-4b16-bcb4-f4bb8d00fb74 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:46.937119 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-af699b9b-0359-4b16-bcb4-f4bb8d00fb74 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1763 microversion: 2.1 time: 0.170633 May 26 16:47:46.937683 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 326/655] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:46 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1763 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:47.416908 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-251cf0fd-89d7-400c-bb89-580b09035125 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:47:47.423465 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-251cf0fd-89d7-400c-bb89-580b09035125 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:47.423911 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-251cf0fd-89d7-400c-bb89-580b09035125 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:47.445826 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-251cf0fd-89d7-400c-bb89-580b09035125 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Going to try to stop instance {{(pid=124266) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 26 16:47:47.489201 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-251cf0fd-89d7-400c-bb89-580b09035125 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "POST /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29/action" status: 202 len: 0 microversion: 2.1 time: 0.075946 May 26 16:47:47.489805 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 330/656] 10.222.0.102 () {60 vars in 1282 bytes} [Thu May 26 16:47:47 2022] POST /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 16:47:47.498620 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-b91964af-4411-411c-91d6-3c2f53121e0c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:47.499233 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-b91964af-4411-411c-91d6-3c2f53121e0c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:47.506531 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b91964af-4411-411c-91d6-3c2f53121e0c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:47.507135 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b91964af-4411-411c-91d6-3c2f53121e0c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:47.507911 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b91964af-4411-411c-91d6-3c2f53121e0c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:47.508703 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b91964af-4411-411c-91d6-3c2f53121e0c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:47.642073 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-b91964af-4411-411c-91d6-3c2f53121e0c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:47.650265 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-b91964af-4411-411c-91d6-3c2f53121e0c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1681 microversion: 2.1 time: 0.155919 May 26 16:47:47.650830 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 327/657] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:47 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:48.668146 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-64bcd230-e1c4-448e-bc39-fbd46eb05385 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:48.668785 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-64bcd230-e1c4-448e-bc39-fbd46eb05385 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:48.674888 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-64bcd230-e1c4-448e-bc39-fbd46eb05385 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:48.675833 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-64bcd230-e1c4-448e-bc39-fbd46eb05385 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:48.676613 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-64bcd230-e1c4-448e-bc39-fbd46eb05385 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:48.677044 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-64bcd230-e1c4-448e-bc39-fbd46eb05385 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:48.806779 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-64bcd230-e1c4-448e-bc39-fbd46eb05385 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:48.814203 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-64bcd230-e1c4-448e-bc39-fbd46eb05385 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1681 microversion: 2.1 time: 0.150749 May 26 16:47:48.814771 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 331/658] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:48 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:49.833290 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-d16a6e07-9a61-4ace-a7cd-6be1f553ca42 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:49.833834 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-d16a6e07-9a61-4ace-a7cd-6be1f553ca42 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:49.840445 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d16a6e07-9a61-4ace-a7cd-6be1f553ca42 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:49.840898 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d16a6e07-9a61-4ace-a7cd-6be1f553ca42 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:49.841666 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d16a6e07-9a61-4ace-a7cd-6be1f553ca42 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:49.842094 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d16a6e07-9a61-4ace-a7cd-6be1f553ca42 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:49.977670 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-d16a6e07-9a61-4ace-a7cd-6be1f553ca42 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:49.985079 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-d16a6e07-9a61-4ace-a7cd-6be1f553ca42 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1681 microversion: 2.1 time: 0.156423 May 26 16:47:49.985643 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 328/659] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:49 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:47:50.787539 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 16:47:50.788165 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Thu May 26 16:47:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 16:47:51.002348 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6baa5e8a-b210-460b-b8c9-c3eaa9f69eda tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:51.002964 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-6baa5e8a-b210-460b-b8c9-c3eaa9f69eda tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:51.009736 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6baa5e8a-b210-460b-b8c9-c3eaa9f69eda tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:51.010188 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6baa5e8a-b210-460b-b8c9-c3eaa9f69eda tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:51.011098 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6baa5e8a-b210-460b-b8c9-c3eaa9f69eda tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:51.011574 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6baa5e8a-b210-460b-b8c9-c3eaa9f69eda tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:51.147678 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6baa5e8a-b210-460b-b8c9-c3eaa9f69eda tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:51.155535 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6baa5e8a-b210-460b-b8c9-c3eaa9f69eda tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1681 microversion: 2.1 time: 0.157041 May 26 16:47:51.156175 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 332/660] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:50 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:52.173418 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-3cc86918-75b3-4741-b014-48410a87deaa tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:52.174036 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-3cc86918-75b3-4741-b014-48410a87deaa tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:52.181074 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3cc86918-75b3-4741-b014-48410a87deaa tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:52.181590 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3cc86918-75b3-4741-b014-48410a87deaa tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:52.182362 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3cc86918-75b3-4741-b014-48410a87deaa tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:52.182816 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3cc86918-75b3-4741-b014-48410a87deaa tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:52.328248 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-3cc86918-75b3-4741-b014-48410a87deaa tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:52.336985 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-3cc86918-75b3-4741-b014-48410a87deaa tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1681 microversion: 2.1 time: 0.167387 May 26 16:47:52.337563 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 329/661] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:52 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:53.354158 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-66acc6f2-0857-4212-8de9-ebf969cd38a1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:53.354788 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-66acc6f2-0857-4212-8de9-ebf969cd38a1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:53.361337 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-66acc6f2-0857-4212-8de9-ebf969cd38a1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:53.361782 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-66acc6f2-0857-4212-8de9-ebf969cd38a1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:53.362541 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-66acc6f2-0857-4212-8de9-ebf969cd38a1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:53.362973 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-66acc6f2-0857-4212-8de9-ebf969cd38a1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:53.508864 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-66acc6f2-0857-4212-8de9-ebf969cd38a1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:53.516816 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-66acc6f2-0857-4212-8de9-ebf969cd38a1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1681 microversion: 2.1 time: 0.166350 May 26 16:47:53.517412 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 333/662] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:53 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:54.536002 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-e13ff99c-3601-490a-9d35-193c6f7a5b02 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:54.536637 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-e13ff99c-3601-490a-9d35-193c6f7a5b02 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:54.543343 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e13ff99c-3601-490a-9d35-193c6f7a5b02 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:54.543787 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e13ff99c-3601-490a-9d35-193c6f7a5b02 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:54.544577 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e13ff99c-3601-490a-9d35-193c6f7a5b02 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:54.545007 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e13ff99c-3601-490a-9d35-193c6f7a5b02 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:54.676353 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-e13ff99c-3601-490a-9d35-193c6f7a5b02 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:54.684101 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-e13ff99c-3601-490a-9d35-193c6f7a5b02 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1681 microversion: 2.1 time: 0.152557 May 26 16:47:54.684712 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 330/663] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:54 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:55.701563 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-868eb48f-4a08-4154-a5b2-20fb6a1f5af7 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:55.702109 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-868eb48f-4a08-4154-a5b2-20fb6a1f5af7 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:55.708972 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-868eb48f-4a08-4154-a5b2-20fb6a1f5af7 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:55.709445 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-868eb48f-4a08-4154-a5b2-20fb6a1f5af7 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:55.710222 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-868eb48f-4a08-4154-a5b2-20fb6a1f5af7 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:55.710663 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-868eb48f-4a08-4154-a5b2-20fb6a1f5af7 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:55.839275 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-868eb48f-4a08-4154-a5b2-20fb6a1f5af7 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:55.841488 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:55.848472 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-868eb48f-4a08-4154-a5b2-20fb6a1f5af7 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1681 microversion: 2.1 time: 0.150819 May 26 16:47:55.849036 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 334/664] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:55 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:56.867075 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-fc3e6aae-c4df-4b7e-89ed-da5034b880df tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:56.867744 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-fc3e6aae-c4df-4b7e-89ed-da5034b880df tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:56.875018 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fc3e6aae-c4df-4b7e-89ed-da5034b880df tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:56.875474 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fc3e6aae-c4df-4b7e-89ed-da5034b880df tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:56.876249 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fc3e6aae-c4df-4b7e-89ed-da5034b880df tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:56.876722 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fc3e6aae-c4df-4b7e-89ed-da5034b880df tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:57.016032 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-fc3e6aae-c4df-4b7e-89ed-da5034b880df tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:57.023496 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-fc3e6aae-c4df-4b7e-89ed-da5034b880df tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1681 microversion: 2.1 time: 0.161519 May 26 16:47:57.024065 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 331/665] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:56 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:58.041416 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-bf933db1-15eb-48bf-9949-73b1c60a5cd2 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:58.042073 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-bf933db1-15eb-48bf-9949-73b1c60a5cd2 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:58.049505 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bf933db1-15eb-48bf-9949-73b1c60a5cd2 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:58.049955 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bf933db1-15eb-48bf-9949-73b1c60a5cd2 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:58.050745 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bf933db1-15eb-48bf-9949-73b1c60a5cd2 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:58.051180 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bf933db1-15eb-48bf-9949-73b1c60a5cd2 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:58.188706 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-bf933db1-15eb-48bf-9949-73b1c60a5cd2 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:58.197236 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-bf933db1-15eb-48bf-9949-73b1c60a5cd2 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1681 microversion: 2.1 time: 0.160470 May 26 16:47:58.197816 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 335/666] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:58 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:58.829673 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 16:47:58.830362 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Thu May 26 16:47:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 16:47:59.223956 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-554a965f-7a4d-45a1-ae97-9949410d8424 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:59.224563 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-554a965f-7a4d-45a1-ae97-9949410d8424 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:47:59.231718 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-554a965f-7a4d-45a1-ae97-9949410d8424 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:59.232187 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-554a965f-7a4d-45a1-ae97-9949410d8424 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:59.233021 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-554a965f-7a4d-45a1-ae97-9949410d8424 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:47:59.233495 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-554a965f-7a4d-45a1-ae97-9949410d8424 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:47:59.393028 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-554a965f-7a4d-45a1-ae97-9949410d8424 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:47:59.403616 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-554a965f-7a4d-45a1-ae97-9949410d8424 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1681 microversion: 2.1 time: 0.185043 May 26 16:47:59.404200 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 332/667] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:47:59 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1681 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:48:00.422803 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d083b767-ca9f-4f29-9805-e9f54d77f1a6 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:00.423456 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d083b767-ca9f-4f29-9805-e9f54d77f1a6 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:00.430904 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d083b767-ca9f-4f29-9805-e9f54d77f1a6 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:00.432261 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d083b767-ca9f-4f29-9805-e9f54d77f1a6 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:00.440230 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d083b767-ca9f-4f29-9805-e9f54d77f1a6 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:00.440714 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d083b767-ca9f-4f29-9805-e9f54d77f1a6 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:00.589913 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d083b767-ca9f-4f29-9805-e9f54d77f1a6 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:00.598301 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d083b767-ca9f-4f29-9805-e9f54d77f1a6 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1681 microversion: 2.1 time: 0.178800 May 26 16:48:00.598858 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 336/668] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:48:00 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1681 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:48:01.616762 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-2efbd5a6-57a3-4ee5-b9d0-e83c98071311 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:01.617544 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-2efbd5a6-57a3-4ee5-b9d0-e83c98071311 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:01.623854 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2efbd5a6-57a3-4ee5-b9d0-e83c98071311 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:01.624299 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2efbd5a6-57a3-4ee5-b9d0-e83c98071311 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:01.625100 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2efbd5a6-57a3-4ee5-b9d0-e83c98071311 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:01.625536 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2efbd5a6-57a3-4ee5-b9d0-e83c98071311 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:01.776764 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-2efbd5a6-57a3-4ee5-b9d0-e83c98071311 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:01.784578 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-2efbd5a6-57a3-4ee5-b9d0-e83c98071311 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1681 microversion: 2.1 time: 0.172192 May 26 16:48:01.785647 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 333/669] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:48:01 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:48:02.802533 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e1efc68a-3171-43c4-a633-2bf9587396fb tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:02.803136 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e1efc68a-3171-43c4-a633-2bf9587396fb tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:02.809817 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e1efc68a-3171-43c4-a633-2bf9587396fb tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:02.810259 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e1efc68a-3171-43c4-a633-2bf9587396fb tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:02.811024 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e1efc68a-3171-43c4-a633-2bf9587396fb tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:02.811458 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e1efc68a-3171-43c4-a633-2bf9587396fb tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:02.962871 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e1efc68a-3171-43c4-a633-2bf9587396fb tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:02.970537 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e1efc68a-3171-43c4-a633-2bf9587396fb tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1681 microversion: 2.1 time: 0.171824 May 26 16:48:02.971097 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 337/670] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:48:02 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:48:03.987033 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-110d1e29-0fa6-442c-93dc-0f05ecda4a93 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:03.987575 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-110d1e29-0fa6-442c-93dc-0f05ecda4a93 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:03.994041 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-110d1e29-0fa6-442c-93dc-0f05ecda4a93 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:03.994504 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-110d1e29-0fa6-442c-93dc-0f05ecda4a93 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:03.995268 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-110d1e29-0fa6-442c-93dc-0f05ecda4a93 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:03.995708 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-110d1e29-0fa6-442c-93dc-0f05ecda4a93 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:03.998260 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=1 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:04.135476 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-110d1e29-0fa6-442c-93dc-0f05ecda4a93 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:04.144022 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-110d1e29-0fa6-442c-93dc-0f05ecda4a93 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1658 microversion: 2.1 time: 0.160772 May 26 16:48:04.145173 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 334/671] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:48:03 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1658 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:48:04.161861 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3156a50c-5982-458c-8573-69000b9d051f tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:48:04.168482 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3156a50c-5982-458c-8573-69000b9d051f tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:04.168946 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3156a50c-5982-458c-8573-69000b9d051f tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:04.190297 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-3156a50c-5982-458c-8573-69000b9d051f tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Going to try to start instance {{(pid=124266) start /opt/stack/nova/nova/compute/api.py:2730}} May 26 16:48:04.234693 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-3156a50c-5982-458c-8573-69000b9d051f tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "POST /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29/action" status: 202 len: 0 microversion: 2.1 time: 0.076615 May 26 16:48:04.235532 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 338/672] 10.222.0.102 () {60 vars in 1282 bytes} [Thu May 26 16:48:04 2022] POST /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 16:48:04.243880 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-6f71253f-a444-4846-abd4-613fc2a6d0c8 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:04.244515 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-6f71253f-a444-4846-abd4-613fc2a6d0c8 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:04.250638 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-6f71253f-a444-4846-abd4-613fc2a6d0c8 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:04.251084 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-6f71253f-a444-4846-abd4-613fc2a6d0c8 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:04.251884 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-6f71253f-a444-4846-abd4-613fc2a6d0c8 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:04.252318 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-6f71253f-a444-4846-abd4-613fc2a6d0c8 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:04.429512 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-6f71253f-a444-4846-abd4-613fc2a6d0c8 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:04.437218 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-6f71253f-a444-4846-abd4-613fc2a6d0c8 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1667 microversion: 2.1 time: 0.197162 May 26 16:48:04.437806 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 335/673] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:48:04 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1667 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:48:05.456309 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a430d265-4b1a-4c34-9b27-59626ca6db5d tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:05.457719 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a430d265-4b1a-4c34-9b27-59626ca6db5d tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:05.464622 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a430d265-4b1a-4c34-9b27-59626ca6db5d tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:05.465095 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a430d265-4b1a-4c34-9b27-59626ca6db5d tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:05.465947 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a430d265-4b1a-4c34-9b27-59626ca6db5d tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:05.466339 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a430d265-4b1a-4c34-9b27-59626ca6db5d tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:05.647105 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a430d265-4b1a-4c34-9b27-59626ca6db5d tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:05.655568 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a430d265-4b1a-4c34-9b27-59626ca6db5d tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1667 microversion: 2.1 time: 0.203476 May 26 16:48:05.656154 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 339/674] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:48:05 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1667 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:48:06.681430 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-6ac3ff40-4df9-43f5-8a3c-282fcb83606c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:06.682511 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-6ac3ff40-4df9-43f5-8a3c-282fcb83606c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:06.694340 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-6ac3ff40-4df9-43f5-8a3c-282fcb83606c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:06.696017 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-6ac3ff40-4df9-43f5-8a3c-282fcb83606c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:06.697585 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-6ac3ff40-4df9-43f5-8a3c-282fcb83606c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:06.698380 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-6ac3ff40-4df9-43f5-8a3c-282fcb83606c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:06.864833 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-6ac3ff40-4df9-43f5-8a3c-282fcb83606c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:06.872616 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-6ac3ff40-4df9-43f5-8a3c-282fcb83606c tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1671 microversion: 2.1 time: 0.198488 May 26 16:48:06.873198 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 336/675] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:48:06 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1671 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:48:19.896031 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e4b0ca9c-1003-4b96-82b0-59bfaacc8346 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:19.896745 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e4b0ca9c-1003-4b96-82b0-59bfaacc8346 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:19.898981 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=23 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:19.899699 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:19.905538 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e4b0ca9c-1003-4b96-82b0-59bfaacc8346 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:19.905980 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e4b0ca9c-1003-4b96-82b0-59bfaacc8346 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:19.906753 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e4b0ca9c-1003-4b96-82b0-59bfaacc8346 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:19.907212 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e4b0ca9c-1003-4b96-82b0-59bfaacc8346 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:19.942316 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e4b0ca9c-1003-4b96-82b0-59bfaacc8346 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9/os-volume_attachments/7b2d8ec6-1482-43a3-b6f4-d6faf41d294c" status: 200 len: 194 microversion: 2.20 time: 0.050838 May 26 16:48:19.942932 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 340/676] 10.222.0.102 () {60 vars in 1458 bytes} [Thu May 26 16:48:19 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9/os-volume_attachments/7b2d8ec6-1482-43a3-b6f4-d6faf41d294c => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:48:20.038541 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_api:SELECT=25 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:20.039920 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=17 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:20.046135 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-6294758c-27ac-464a-a0f0-3a2239d92251 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:20.046642 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-6294758c-27ac-464a-a0f0-3a2239d92251 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:20.054429 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-6294758c-27ac-464a-a0f0-3a2239d92251 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:20.054879 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-6294758c-27ac-464a-a0f0-3a2239d92251 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:20.055682 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-6294758c-27ac-464a-a0f0-3a2239d92251 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:20.056115 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-6294758c-27ac-464a-a0f0-3a2239d92251 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:20.144244 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.objects.instance [None req-6294758c-27ac-464a-a0f0-3a2239d92251 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lazy-loading 'services' on Instance uuid a636d450-9d10-45a5-9982-9e10393fc4a9 {{(pid=124267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:48:20.224890 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-6294758c-27ac-464a-a0f0-3a2239d92251 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "DELETE /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9/os-volume_attachments/7b2d8ec6-1482-43a3-b6f4-d6faf41d294c" status: 202 len: 0 microversion: 2.20 time: 0.188301 May 26 16:48:20.225501 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 337/677] 10.222.0.102 () {60 vars in 1461 bytes} [Thu May 26 16:48:20 2022] DELETE /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9/os-volume_attachments/7b2d8ec6-1482-43a3-b6f4-d6faf41d294c => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 16:48:20.234215 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8844142e-78b4-4b16-8037-05d0844d5f31 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:20.235238 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-8844142e-78b4-4b16-8037-05d0844d5f31 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:20.242578 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8844142e-78b4-4b16-8037-05d0844d5f31 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:20.243026 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8844142e-78b4-4b16-8037-05d0844d5f31 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:20.243818 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8844142e-78b4-4b16-8037-05d0844d5f31 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:20.244301 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8844142e-78b4-4b16-8037-05d0844d5f31 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:20.283356 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-8844142e-78b4-4b16-8037-05d0844d5f31 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053120 May 26 16:48:20.284566 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 341/678] 10.222.0.102 () {60 vars in 1347 bytes} [Thu May 26 16:48:20 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:48:21.296514 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-61106d8e-990e-4ec5-ba5d-0f218092521c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:21.297593 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-61106d8e-990e-4ec5-ba5d-0f218092521c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:21.304845 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-61106d8e-990e-4ec5-ba5d-0f218092521c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:21.305297 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-61106d8e-990e-4ec5-ba5d-0f218092521c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:21.306080 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-61106d8e-990e-4ec5-ba5d-0f218092521c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:21.306511 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-61106d8e-990e-4ec5-ba5d-0f218092521c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:21.349608 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-61106d8e-990e-4ec5-ba5d-0f218092521c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057606 May 26 16:48:21.350091 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 338/679] 10.222.0.102 () {60 vars in 1347 bytes} [Thu May 26 16:48:21 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:48:22.361625 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-564f2261-d10e-4574-8971-8b8e35c73751 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:22.362994 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-564f2261-d10e-4574-8971-8b8e35c73751 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:22.369836 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-564f2261-d10e-4574-8971-8b8e35c73751 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:22.370325 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-564f2261-d10e-4574-8971-8b8e35c73751 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:22.371111 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-564f2261-d10e-4574-8971-8b8e35c73751 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:22.371550 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-564f2261-d10e-4574-8971-8b8e35c73751 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:22.404201 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-564f2261-d10e-4574-8971-8b8e35c73751 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046583 May 26 16:48:22.404806 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 342/680] 10.222.0.102 () {60 vars in 1347 bytes} [Thu May 26 16:48:22 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:48:22.477838 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-326ca9a8-a293-4624-b863-55859d20b420 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:22.478395 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-326ca9a8-a293-4624-b863-55859d20b420 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:22.485154 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-326ca9a8-a293-4624-b863-55859d20b420 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:22.485600 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-326ca9a8-a293-4624-b863-55859d20b420 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:22.486372 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-326ca9a8-a293-4624-b863-55859d20b420 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:22.486801 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-326ca9a8-a293-4624-b863-55859d20b420 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:22.516797 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-326ca9a8-a293-4624-b863-55859d20b420 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Going to try to terminate instance {{(pid=124267) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 16:48:22.601961 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-326ca9a8-a293-4624-b863-55859d20b420 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "DELETE /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 204 len: 0 microversion: 2.20 time: 0.127759 May 26 16:48:22.602893 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 339/681] 10.222.0.102 () {60 vars in 1284 bytes} [Thu May 26 16:48:22 2022] DELETE /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 16:48:22.616195 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9dbc0368-c285-4227-b1ba-5a6ffa737c83 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:22.616746 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9dbc0368-c285-4227-b1ba-5a6ffa737c83 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:22.623546 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9dbc0368-c285-4227-b1ba-5a6ffa737c83 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:22.624001 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9dbc0368-c285-4227-b1ba-5a6ffa737c83 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:22.624793 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9dbc0368-c285-4227-b1ba-5a6ffa737c83 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:22.625227 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9dbc0368-c285-4227-b1ba-5a6ffa737c83 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:22.791354 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9dbc0368-c285-4227-b1ba-5a6ffa737c83 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:22.800926 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9dbc0368-c285-4227-b1ba-5a6ffa737c83 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:22.802460 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9dbc0368-c285-4227-b1ba-5a6ffa737c83 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:22.803652 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9dbc0368-c285-4227-b1ba-5a6ffa737c83 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1729 microversion: 2.20 time: 0.193763 May 26 16:48:22.804241 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 343/682] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:48:22 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1729 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:48:23.828255 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-64dc7bca-0a76-4a03-9715-4dc807130f70 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:23.828993 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-64dc7bca-0a76-4a03-9715-4dc807130f70 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:23.836339 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-64dc7bca-0a76-4a03-9715-4dc807130f70 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:23.836820 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-64dc7bca-0a76-4a03-9715-4dc807130f70 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:23.837601 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-64dc7bca-0a76-4a03-9715-4dc807130f70 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:23.838037 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-64dc7bca-0a76-4a03-9715-4dc807130f70 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:23.979412 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-64dc7bca-0a76-4a03-9715-4dc807130f70 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:23.988236 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-64dc7bca-0a76-4a03-9715-4dc807130f70 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:23.989874 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-64dc7bca-0a76-4a03-9715-4dc807130f70 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:23.991114 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-64dc7bca-0a76-4a03-9715-4dc807130f70 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1729 microversion: 2.20 time: 0.170757 May 26 16:48:23.991683 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 340/683] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:48:23 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:48:25.010107 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-641fa08d-681d-4632-9884-8aace7033497 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:25.010741 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-641fa08d-681d-4632-9884-8aace7033497 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:25.017419 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-641fa08d-681d-4632-9884-8aace7033497 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:25.018063 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-641fa08d-681d-4632-9884-8aace7033497 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:25.019523 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-641fa08d-681d-4632-9884-8aace7033497 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:25.020015 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-641fa08d-681d-4632-9884-8aace7033497 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:25.683465 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-641fa08d-681d-4632-9884-8aace7033497 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:25.692255 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-641fa08d-681d-4632-9884-8aace7033497 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:25.694078 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-641fa08d-681d-4632-9884-8aace7033497 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:25.696057 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-641fa08d-681d-4632-9884-8aace7033497 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1729 microversion: 2.20 time: 0.689729 May 26 16:48:25.696938 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 344/684] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:48:25 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1729 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:48:26.576245 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-9b31ad69-337f-419a-88fc-14a9582aabdc req-ba726ad1-bf87-4883-87cc-0e9b052efb66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a636d450-9d10-45a5-9982-9e10393fc4a9", "name": "network-vif-deleted", "tag": "444eb6a1-a511-4e39-a006-252d0ba39886"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:48:26.588856 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-9b31ad69-337f-419a-88fc-14a9582aabdc req-ba726ad1-bf87-4883-87cc-0e9b052efb66 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:26.589305 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-9b31ad69-337f-419a-88fc-14a9582aabdc req-ba726ad1-bf87-4883-87cc-0e9b052efb66 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:26.603997 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-9b31ad69-337f-419a-88fc-14a9582aabdc req-ba726ad1-bf87-4883-87cc-0e9b052efb66 service nova] Creating event network-vif-deleted:444eb6a1-a511-4e39-a006-252d0ba39886 for instance a636d450-9d10-45a5-9982-9e10393fc4a9 on hv-cinder-83607 May 26 16:48:26.610313 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-9b31ad69-337f-419a-88fc-14a9582aabdc req-ba726ad1-bf87-4883-87cc-0e9b052efb66 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128721 May 26 16:48:26.610933 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 341/685] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:48:26.722695 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7ce6a5aa-eb6a-4666-969e-07c9aeeeaadb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:26.723372 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-7ce6a5aa-eb6a-4666-969e-07c9aeeeaadb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:26.730945 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7ce6a5aa-eb6a-4666-969e-07c9aeeeaadb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:26.731522 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7ce6a5aa-eb6a-4666-969e-07c9aeeeaadb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:26.732553 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7ce6a5aa-eb6a-4666-969e-07c9aeeeaadb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:26.733155 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7ce6a5aa-eb6a-4666-969e-07c9aeeeaadb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:26.769768 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7ce6a5aa-eb6a-4666-969e-07c9aeeeaadb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:26.770230 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7ce6a5aa-eb6a-4666-969e-07c9aeeeaadb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:26.770701 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.objects.instance [None req-7ce6a5aa-eb6a-4666-969e-07c9aeeeaadb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lazy-loading 'fault' on Instance uuid a636d450-9d10-45a5-9982-9e10393fc4a9 {{(pid=124266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:48:26.823634 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7ce6a5aa-eb6a-4666-969e-07c9aeeeaadb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:26.833130 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7ce6a5aa-eb6a-4666-969e-07c9aeeeaadb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:26.835085 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7ce6a5aa-eb6a-4666-969e-07c9aeeeaadb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:26.836573 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7ce6a5aa-eb6a-4666-969e-07c9aeeeaadb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 200 len: 1375 microversion: 2.20 time: 0.118372 May 26 16:48:26.837378 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 345/686] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:48:26 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 1375 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:48:27.857080 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-e0a8beb0-caf8-4834-ac24-ab673dafb2a0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:27.858064 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-e0a8beb0-caf8-4834-ac24-ab673dafb2a0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:27.864665 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e0a8beb0-caf8-4834-ac24-ab673dafb2a0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:27.865124 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e0a8beb0-caf8-4834-ac24-ab673dafb2a0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:27.865928 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e0a8beb0-caf8-4834-ac24-ab673dafb2a0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:27.866526 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e0a8beb0-caf8-4834-ac24-ab673dafb2a0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:27.881956 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.wsgi [None req-e0a8beb0-caf8-4834-ac24-ab673dafb2a0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] HTTP exception thrown: Instance a636d450-9d10-45a5-9982-9e10393fc4a9 could not be found. May 26 16:48:27.883856 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-e0a8beb0-caf8-4834-ac24-ab673dafb2a0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Request method failure captured: May 26 16:48:27.883856 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: request: GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 HTTP/1.1 May 26 16:48:27.883856 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept: application/json May 26 16:48:27.883856 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept-Encoding: identity May 26 16:48:27.883856 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Connection: close May 26 16:48:27.883856 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Length: 0 May 26 16:48:27.883856 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Type: application/json May 26 16:48:27.883856 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Host: 10.222.0.102 May 26 16:48:27.883856 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Openstack-System-Scope: None May 26 16:48:27.883856 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: User-Agent: python-urllib3/1.26.9 May 26 16:48:27.883856 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Auth-Token: gAAAAABij62ls_QXS8BetfnOiLi3iYdBIzuec_Y4yQ_t8KHJ0A0xyCzG_LOLOt-5f5-V8dnJXpYMtB5srQ1zeCtk_mtqtfxFPdfkmymvPMVpsQVd4u1aa-TIjNfqB4QVQu2wpl1jv5k2K6iYwvEhBfjgKxT3Oo8EipT3zl3l-LIsxMEY5W36dlM May 26 16:48:27.883856 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Id: None May 26 16:48:27.883856 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Name: None May 26 16:48:27.883856 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Identity-Status: Confirmed May 26 16:48:27.883856 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Is-Admin-Project: True May 26 16:48:27.883856 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Openstack-Nova-Api-Version: 2.20 May 26 16:48:27.883856 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Id: default May 26 16:48:27.883856 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Name: Default May 26 16:48:27.883856 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Id: a69cba8eb64f4fcc87bbc6960a0abeb0 May 26 16:48:27.883856 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-465880155 May 26 16:48:27.883856 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Role: reader,member May 26 16:48:27.883856 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Roles: reader,member May 26 16:48:27.885807 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/a69cba8eb64f4fcc87bbc6960a0abeb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/a69cba8eb64f4fcc87bbc6960a0abeb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/a69cba8eb64f4fcc87bbc6960a0abeb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_a69cba8eb64f4fcc87bbc6960a0abeb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:48:27.885807 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant: tempest-AttachVolumeShelveTestJSON-465880155 May 26 16:48:27.885807 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Id: a69cba8eb64f4fcc87bbc6960a0abeb0 May 26 16:48:27.885807 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-465880155 May 26 16:48:27.885807 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User: tempest-AttachVolumeShelveTestJSON-465880155-project May 26 16:48:27.885807 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Id: default May 26 16:48:27.885807 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Name: Default May 26 16:48:27.885807 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Id: e4941664ae624d4190ff53e5965db33f May 26 16:48:27.885807 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Name: tempest-AttachVolumeShelveTestJSON-465880155-project May 26 16:48:27.885807 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: method: > May 26 16:48:27.885807 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: exception: Instance a636d450-9d10-45a5-9982-9e10393fc4a9 could not be found. May 26 16:48:27.885807 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: action_args: {'id': 'a636d450-9d10-45a5-9982-9e10393fc4a9'} May 26 16:48:27.886883 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:48:27.886883 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:48:27.886883 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:48:27.886883 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:48:27.886883 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:48:27.886883 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:48:27.886883 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:48:27.886883 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:48:27.886883 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:48:27.886883 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:48:27.886883 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a636d450-9d10-45a5-9982-9e10393fc4a9 could not be found. May 26 16:48:27.886883 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:48:27.886883 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:48:27.886883 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:48:27.886883 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:48:27.886883 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:48:27.886883 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:48:27.886883 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:48:27.886883 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:48:27.886883 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:48:27.889514 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:48:27.889514 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 16:48:27.889514 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 16:48:27.889514 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:48:27.889514 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:48:27.889514 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:48:27.889514 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:48:27.889514 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a636d450-9d10-45a5-9982-9e10393fc4a9 could not be found. May 26 16:48:27.889514 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:48:27.889514 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:48:27.889514 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:48:27.889514 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:48:27.889514 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:48:27.889514 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:48:27.889514 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:48:27.889514 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:48:27.889514 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a636d450-9d10-45a5-9982-9e10393fc4a9 could not be found. May 26 16:48:27.889514 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:48:27.893746 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-e0a8beb0-caf8-4834-ac24-ab673dafb2a0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Returning 404 to user: Instance a636d450-9d10-45a5-9982-9e10393fc4a9 could not be found. {{(pid=124267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:48:27.893746 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-e0a8beb0-caf8-4834-ac24-ab673dafb2a0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 404 len: 111 microversion: 2.20 time: 0.033442 May 26 16:48:27.893746 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 342/687] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:48:27 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 26 16:48:27.901966 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6ba077e2-8e01-4a7b-884e-35838ec1c965 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '.version_select at 0x7f93a3c03ee0>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:27.938936 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6ba077e2-8e01-4a7b-884e-35838ec1c965 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1583566214" status: 204 len: 0 microversion: 2.20 time: 0.047444 May 26 16:48:27.945138 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 346/688] 10.222.0.102 () {60 vars in 1266 bytes} [Thu May 26 16:48:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1583566214 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 16:48:28.722278 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-207579cf-0e65-48a9-beb1-60433adc9387 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Action: 'create', calling method: .version_select at 0x7f93a3eb98b0>, body: {"keypair": {"name": "tempest-keypair-1967408850", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXwrL2axBynyDrDMD9jPLqLQmT+7RiOsQFVhNcYl2D9WKsZ8SxCCO3P30ZCppsB3jDGpWr0EjDr2UyamU1nS5FMNMXks6bzg5JWiZm3pNUDzjrY6zRenzdWv+A212YPXQ=="}} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:48:28.738277 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.quota [None req-207579cf-0e65-48a9-beb1-60433adc9387 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Getting quotas for project a69cba8eb64f4fcc87bbc6960a0abeb0. Resources: {'key_pairs'} {{(pid=124267) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:48:28.747215 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.quota [None req-207579cf-0e65-48a9-beb1-60433adc9387 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Getting quotas for user e4941664ae624d4190ff53e5965db33f and project a69cba8eb64f4fcc87bbc6960a0abeb0. Resources: {'key_pairs'} {{(pid=124267) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:48:28.776853 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-207579cf-0e65-48a9-beb1-60433adc9387 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.058854 May 26 16:48:28.777866 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 343/689] 10.222.0.102 () {62 vars in 1204 bytes} [Thu May 26 16:48:28 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 60 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 26 16:48:30.431487 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-c33c504e-dec6-4e85-915e-549a1333205c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-662865055", "imageRef": "d74c4a51-21fe-41d5-865a-cb93604ac3aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "56578ead-a93d-4f9e-9d57-95aac2ad89ae"}], "security_groups": [{"name": "tempest-securitygroup--1284596634"}], "key_name": "tempest-keypair-1967408850", "user_data": "}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:48:30.547216 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.network.neutron [None req-c33c504e-dec6-4e85-915e-549a1333205c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] validate_networks() for [('56578ead-a93d-4f9e-9d57-95aac2ad89ae', None, None, None, None, None)] {{(pid=124266) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:48:31.013643 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-c33c504e-dec6-4e85-915e-549a1333205c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Flavor limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:48:31.014064 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-c33c504e-dec6-4e85-915e-549a1333205c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Image limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:48:31.014534 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-c33c504e-dec6-4e85-915e-549a1333205c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Flavor pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:48:31.014941 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-c33c504e-dec6-4e85-915e-549a1333205c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Image pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:48:31.015347 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-c33c504e-dec6-4e85-915e-549a1333205c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:48:31.025776 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c33c504e-dec6-4e85-915e-549a1333205c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:31.026221 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c33c504e-dec6-4e85-915e-549a1333205c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:31.027021 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c33c504e-dec6-4e85-915e-549a1333205c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:31.027457 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c33c504e-dec6-4e85-915e-549a1333205c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:31.045634 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-c33c504e-dec6-4e85-915e-549a1333205c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Getting quotas for project a69cba8eb64f4fcc87bbc6960a0abeb0. Resources: {'cores', 'instances', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:48:31.050585 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-c33c504e-dec6-4e85-915e-549a1333205c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Getting quotas for user e4941664ae624d4190ff53e5965db33f and project a69cba8eb64f4fcc87bbc6960a0abeb0. Resources: {'cores', 'instances', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:48:31.062960 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-c33c504e-dec6-4e85-915e-549a1333205c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Going to run 1 instances... {{(pid=124266) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:48:31.065836 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-c33c504e-dec6-4e85-915e-549a1333205c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d74c4a51-21fe-41d5-865a-cb93604ac3aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:48:31.117361 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-c33c504e-dec6-4e85-915e-549a1333205c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.20 time: 0.691081 May 26 16:48:31.118208 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 347/690] 10.222.0.102 () {62 vars in 1192 bytes} [Thu May 26 16:48:30 2022] POST /compute/v2.1/servers => generated 404 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) May 26 16:48:31.132628 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-4aefa7ea-1040-4493-b63b-76ba9fd521c0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:31.134066 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-4aefa7ea-1040-4493-b63b-76ba9fd521c0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:31.210980 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-4aefa7ea-1040-4493-b63b-76ba9fd521c0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:31.224443 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-4aefa7ea-1040-4493-b63b-76ba9fd521c0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:31.227780 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-4aefa7ea-1040-4493-b63b-76ba9fd521c0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:31.229711 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-4aefa7ea-1040-4493-b63b-76ba9fd521c0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1285 microversion: 2.20 time: 0.104530 May 26 16:48:31.230662 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 344/691] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:48:31 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:48:32.260535 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-577e3a76-9637-4679-b947-5339be494d2e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:32.261692 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-577e3a76-9637-4679-b947-5339be494d2e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:32.273805 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-577e3a76-9637-4679-b947-5339be494d2e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:32.274630 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-577e3a76-9637-4679-b947-5339be494d2e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:32.276059 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-577e3a76-9637-4679-b947-5339be494d2e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:32.276895 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-577e3a76-9637-4679-b947-5339be494d2e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:32.420663 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-577e3a76-9637-4679-b947-5339be494d2e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:32.435783 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-577e3a76-9637-4679-b947-5339be494d2e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:32.439025 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-577e3a76-9637-4679-b947-5339be494d2e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:32.442017 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-577e3a76-9637-4679-b947-5339be494d2e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1345 microversion: 2.20 time: 0.189782 May 26 16:48:32.444191 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 348/692] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:48:32 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1345 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:48:33.463761 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-903aa469-3300-4c9b-9f09-ee09d10544bf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:33.464942 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-903aa469-3300-4c9b-9f09-ee09d10544bf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:33.475022 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-903aa469-3300-4c9b-9f09-ee09d10544bf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:33.475597 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-903aa469-3300-4c9b-9f09-ee09d10544bf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:33.476966 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-903aa469-3300-4c9b-9f09-ee09d10544bf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:33.477711 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-903aa469-3300-4c9b-9f09-ee09d10544bf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:33.743589 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-903aa469-3300-4c9b-9f09-ee09d10544bf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:33.753217 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-903aa469-3300-4c9b-9f09-ee09d10544bf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:33.754791 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-903aa469-3300-4c9b-9f09-ee09d10544bf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:33.755978 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-903aa469-3300-4c9b-9f09-ee09d10544bf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1411 microversion: 2.20 time: 0.297568 May 26 16:48:33.756586 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 345/693] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:48:33 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1411 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:48:34.402184 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-2723207a-07cd-44e1-91f0-f0d329d6eb8d req-a71f7f1a-c0c9-4fdb-b34a-1fdd4f23896a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ead585f3-8422-41d8-9a7e-babd902216ea", "tag": "cc45ab72-d2ad-4d48-a593-2e836c66dcb4"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:48:34.420063 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-2723207a-07cd-44e1-91f0-f0d329d6eb8d req-a71f7f1a-c0c9-4fdb-b34a-1fdd4f23896a service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:34.421349 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-2723207a-07cd-44e1-91f0-f0d329d6eb8d req-a71f7f1a-c0c9-4fdb-b34a-1fdd4f23896a service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:34.462593 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-2723207a-07cd-44e1-91f0-f0d329d6eb8d req-a71f7f1a-c0c9-4fdb-b34a-1fdd4f23896a service nova] Creating event network-changed:cc45ab72-d2ad-4d48-a593-2e836c66dcb4 for instance ead585f3-8422-41d8-9a7e-babd902216ea on hv-cinder-83607 May 26 16:48:34.468277 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-2723207a-07cd-44e1-91f0-f0d329d6eb8d req-a71f7f1a-c0c9-4fdb-b34a-1fdd4f23896a service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075604 May 26 16:48:34.471889 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 349/694] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:48:34.775493 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-28b12d73-3733-446e-b0dd-db5a3c5877db tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:34.776104 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-28b12d73-3733-446e-b0dd-db5a3c5877db tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:34.783260 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-28b12d73-3733-446e-b0dd-db5a3c5877db tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:34.784227 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-28b12d73-3733-446e-b0dd-db5a3c5877db tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:34.785047 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-28b12d73-3733-446e-b0dd-db5a3c5877db tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:34.785484 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-28b12d73-3733-446e-b0dd-db5a3c5877db tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:34.972884 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-28b12d73-3733-446e-b0dd-db5a3c5877db tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:34.983032 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-28b12d73-3733-446e-b0dd-db5a3c5877db tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:34.984684 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-28b12d73-3733-446e-b0dd-db5a3c5877db tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:34.985881 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-28b12d73-3733-446e-b0dd-db5a3c5877db tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1411 microversion: 2.20 time: 0.214422 May 26 16:48:34.986475 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 346/695] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:48:34 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1411 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:48:36.005970 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-511fe323-d5fc-44b3-97e3-47053c1cfa45 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:36.006832 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-511fe323-d5fc-44b3-97e3-47053c1cfa45 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:36.013433 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-511fe323-d5fc-44b3-97e3-47053c1cfa45 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:36.013887 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-511fe323-d5fc-44b3-97e3-47053c1cfa45 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:36.014675 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-511fe323-d5fc-44b3-97e3-47053c1cfa45 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:36.015117 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-511fe323-d5fc-44b3-97e3-47053c1cfa45 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:36.195712 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-511fe323-d5fc-44b3-97e3-47053c1cfa45 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:36.204306 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-511fe323-d5fc-44b3-97e3-47053c1cfa45 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:36.206876 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-511fe323-d5fc-44b3-97e3-47053c1cfa45 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:36.209128 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-511fe323-d5fc-44b3-97e3-47053c1cfa45 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1411 microversion: 2.20 time: 0.207667 May 26 16:48:36.210040 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 350/696] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:48:35 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1411 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:48:37.227805 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-ca0da908-86c8-4e28-b08c-345087708864 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:37.228455 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-ca0da908-86c8-4e28-b08c-345087708864 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:37.235376 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ca0da908-86c8-4e28-b08c-345087708864 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:37.235854 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ca0da908-86c8-4e28-b08c-345087708864 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:37.236685 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ca0da908-86c8-4e28-b08c-345087708864 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:37.237119 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ca0da908-86c8-4e28-b08c-345087708864 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:37.390516 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-ca0da908-86c8-4e28-b08c-345087708864 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:37.404422 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-ca0da908-86c8-4e28-b08c-345087708864 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:37.407668 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-ca0da908-86c8-4e28-b08c-345087708864 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:37.409981 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-ca0da908-86c8-4e28-b08c-345087708864 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1411 microversion: 2.20 time: 0.186178 May 26 16:48:37.411077 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 347/697] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:48:37 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1411 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:48:38.428591 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e94466c9-912e-45a8-b692-21781ce0141a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:38.429204 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e94466c9-912e-45a8-b692-21781ce0141a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:38.435913 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e94466c9-912e-45a8-b692-21781ce0141a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:38.436360 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e94466c9-912e-45a8-b692-21781ce0141a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:38.437178 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e94466c9-912e-45a8-b692-21781ce0141a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:38.437667 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e94466c9-912e-45a8-b692-21781ce0141a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:38.579361 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e94466c9-912e-45a8-b692-21781ce0141a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:38.588698 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e94466c9-912e-45a8-b692-21781ce0141a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:38.590205 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e94466c9-912e-45a8-b692-21781ce0141a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:38.591330 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e94466c9-912e-45a8-b692-21781ce0141a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1411 microversion: 2.20 time: 0.166706 May 26 16:48:38.591917 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 351/698] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:48:38 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1411 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:48:39.609116 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-fd2ecf74-643e-43b9-acac-b02e94777f2b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:39.609692 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-fd2ecf74-643e-43b9-acac-b02e94777f2b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:39.616904 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fd2ecf74-643e-43b9-acac-b02e94777f2b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:39.617348 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fd2ecf74-643e-43b9-acac-b02e94777f2b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:39.618127 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fd2ecf74-643e-43b9-acac-b02e94777f2b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:39.618557 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fd2ecf74-643e-43b9-acac-b02e94777f2b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:39.750983 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-fd2ecf74-643e-43b9-acac-b02e94777f2b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:39.761402 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-fd2ecf74-643e-43b9-acac-b02e94777f2b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:39.762686 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-fd2ecf74-643e-43b9-acac-b02e94777f2b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:39.763827 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-fd2ecf74-643e-43b9-acac-b02e94777f2b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1411 microversion: 2.20 time: 0.158710 May 26 16:48:39.764411 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 348/699] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:48:39 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1411 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:48:40.646794 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-16bfb03f-0389-4359-90e1-63fc0c7dcf81 req-ebb0dff7-25e7-427b-9355-9248dca3c3f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead585f3-8422-41d8-9a7e-babd902216ea", "name": "network-vif-plugged", "status": "completed", "tag": "cc45ab72-d2ad-4d48-a593-2e836c66dcb4"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:48:40.656581 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-16bfb03f-0389-4359-90e1-63fc0c7dcf81 req-ebb0dff7-25e7-427b-9355-9248dca3c3f9 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:40.657105 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-16bfb03f-0389-4359-90e1-63fc0c7dcf81 req-ebb0dff7-25e7-427b-9355-9248dca3c3f9 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:40.670873 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-16bfb03f-0389-4359-90e1-63fc0c7dcf81 req-ebb0dff7-25e7-427b-9355-9248dca3c3f9 service nova] Creating event network-vif-plugged:cc45ab72-d2ad-4d48-a593-2e836c66dcb4 for instance ead585f3-8422-41d8-9a7e-babd902216ea on hv-cinder-83607 May 26 16:48:40.675778 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-16bfb03f-0389-4359-90e1-63fc0c7dcf81 req-ebb0dff7-25e7-427b-9355-9248dca3c3f9 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033249 May 26 16:48:40.676574 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 352/700] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:48:40.782565 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-c941e0d2-8b08-46b0-b92a-ded211c97efc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:40.783316 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-c941e0d2-8b08-46b0-b92a-ded211c97efc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:40.790438 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c941e0d2-8b08-46b0-b92a-ded211c97efc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:40.790872 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c941e0d2-8b08-46b0-b92a-ded211c97efc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:40.791669 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c941e0d2-8b08-46b0-b92a-ded211c97efc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:40.792083 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c941e0d2-8b08-46b0-b92a-ded211c97efc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:40.995950 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-c941e0d2-8b08-46b0-b92a-ded211c97efc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:41.005055 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-c941e0d2-8b08-46b0-b92a-ded211c97efc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:41.006629 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-c941e0d2-8b08-46b0-b92a-ded211c97efc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:41.007769 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-c941e0d2-8b08-46b0-b92a-ded211c97efc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1411 microversion: 2.20 time: 0.229706 May 26 16:48:41.008340 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 349/701] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:48:40 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1411 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:48:42.024256 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:42.025066 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=6 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:42.029740 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-83c8786f-e391-4362-82f7-d3f1c24cf38f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:42.030447 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-83c8786f-e391-4362-82f7-d3f1c24cf38f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:42.038178 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-83c8786f-e391-4362-82f7-d3f1c24cf38f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:42.038628 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-83c8786f-e391-4362-82f7-d3f1c24cf38f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:42.039417 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-83c8786f-e391-4362-82f7-d3f1c24cf38f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:42.039837 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-83c8786f-e391-4362-82f7-d3f1c24cf38f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:42.170736 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-83c8786f-e391-4362-82f7-d3f1c24cf38f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:42.179088 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-83c8786f-e391-4362-82f7-d3f1c24cf38f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:42.180701 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-83c8786f-e391-4362-82f7-d3f1c24cf38f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:42.181865 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-83c8786f-e391-4362-82f7-d3f1c24cf38f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1411 microversion: 2.20 time: 0.158578 May 26 16:48:42.182434 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 353/702] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:48:42 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1411 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:48:43.201364 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-21e21efe-4353-4a61-96c5-fd162541311a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:43.202005 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-21e21efe-4353-4a61-96c5-fd162541311a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:43.204293 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell0:SELECT=6 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:43.211796 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-21e21efe-4353-4a61-96c5-fd162541311a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:43.212249 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-21e21efe-4353-4a61-96c5-fd162541311a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:43.213070 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-21e21efe-4353-4a61-96c5-fd162541311a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:43.213516 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-21e21efe-4353-4a61-96c5-fd162541311a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:43.372185 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-21e21efe-4353-4a61-96c5-fd162541311a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:43.381973 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-21e21efe-4353-4a61-96c5-fd162541311a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:43.383585 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-21e21efe-4353-4a61-96c5-fd162541311a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:43.384833 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-21e21efe-4353-4a61-96c5-fd162541311a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1411 microversion: 2.20 time: 0.187455 May 26 16:48:43.387107 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 350/703] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:48:43 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1411 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:48:44.405210 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-dbd2c636-8217-4e7a-9eb4-c1a33f5764fd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:44.405820 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-dbd2c636-8217-4e7a-9eb4-c1a33f5764fd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:44.413766 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dbd2c636-8217-4e7a-9eb4-c1a33f5764fd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:44.414234 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dbd2c636-8217-4e7a-9eb4-c1a33f5764fd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:44.415002 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dbd2c636-8217-4e7a-9eb4-c1a33f5764fd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:44.415440 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dbd2c636-8217-4e7a-9eb4-c1a33f5764fd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:44.560073 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-dbd2c636-8217-4e7a-9eb4-c1a33f5764fd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:44.569697 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-dbd2c636-8217-4e7a-9eb4-c1a33f5764fd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:44.571132 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-dbd2c636-8217-4e7a-9eb4-c1a33f5764fd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:44.572397 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-dbd2c636-8217-4e7a-9eb4-c1a33f5764fd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1603 microversion: 2.20 time: 0.171083 May 26 16:48:44.572988 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 354/704] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:48:44 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1603 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:48:44.602785 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-10629e17-3947-4678-a404-fc1805916f6c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:44.603414 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-10629e17-3947-4678-a404-fc1805916f6c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:44.610555 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-10629e17-3947-4678-a404-fc1805916f6c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:44.611001 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-10629e17-3947-4678-a404-fc1805916f6c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:44.611797 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-10629e17-3947-4678-a404-fc1805916f6c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:44.612227 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-10629e17-3947-4678-a404-fc1805916f6c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:44.696817 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-10629e17-3947-4678-a404-fc1805916f6c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.100957 May 26 16:48:44.697433 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 351/705] 10.222.0.102 () {60 vars in 1320 bytes} [Thu May 26 16:48:44 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:48:44.958935 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1475b837-f043-4596-a09e-3788b249a97e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:48:44.959480 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1475b837-f043-4596-a09e-3788b249a97e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:44.966319 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1475b837-f043-4596-a09e-3788b249a97e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:44.966774 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1475b837-f043-4596-a09e-3788b249a97e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:44.967565 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1475b837-f043-4596-a09e-3788b249a97e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:44.968094 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1475b837-f043-4596-a09e-3788b249a97e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:44.996322 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.objects.instance [None req-1475b837-f043-4596-a09e-3788b249a97e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lazy-loading 'flavor' on Instance uuid 898074a4-2c24-403a-bdd9-e9809f6375fd {{(pid=124266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:48:45.077451 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1475b837-f043-4596-a09e-3788b249a97e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "POST /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd/action" status: 202 len: 0 microversion: 2.1 time: 0.122336 May 26 16:48:45.078245 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 355/706] 10.222.0.102 () {60 vars in 1282 bytes} [Thu May 26 16:48:44 2022] POST /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 16:48:45.091904 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-122f7c60-6d62-4f4e-b7ef-c534a5356523 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:45.092974 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-122f7c60-6d62-4f4e-b7ef-c534a5356523 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:45.106104 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-122f7c60-6d62-4f4e-b7ef-c534a5356523 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:45.106985 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-122f7c60-6d62-4f4e-b7ef-c534a5356523 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:45.108689 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-122f7c60-6d62-4f4e-b7ef-c534a5356523 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:45.108837 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-122f7c60-6d62-4f4e-b7ef-c534a5356523 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:45.355821 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-122f7c60-6d62-4f4e-b7ef-c534a5356523 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:45.365856 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-122f7c60-6d62-4f4e-b7ef-c534a5356523 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1572 microversion: 2.1 time: 0.281789 May 26 16:48:45.366640 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 352/707] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:48:45 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1572 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:48:45.831681 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-3ea1666a-6c8d-4c5f-936a-332c28454efc req-b803c086-ef8e-4263-ad69-97adfc03df01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ead585f3-8422-41d8-9a7e-babd902216ea", "tag": "cc45ab72-d2ad-4d48-a593-2e836c66dcb4"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:48:45.840631 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-3ea1666a-6c8d-4c5f-936a-332c28454efc req-b803c086-ef8e-4263-ad69-97adfc03df01 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:45.841074 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-3ea1666a-6c8d-4c5f-936a-332c28454efc req-b803c086-ef8e-4263-ad69-97adfc03df01 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:45.856362 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-3ea1666a-6c8d-4c5f-936a-332c28454efc req-b803c086-ef8e-4263-ad69-97adfc03df01 service nova] Creating event network-changed:cc45ab72-d2ad-4d48-a593-2e836c66dcb4 for instance ead585f3-8422-41d8-9a7e-babd902216ea on hv-cinder-83607 May 26 16:48:45.862177 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-3ea1666a-6c8d-4c5f-936a-332c28454efc req-b803c086-ef8e-4263-ad69-97adfc03df01 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034786 May 26 16:48:45.862794 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 356/708] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:48:46.387709 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-084279f3-e57d-4634-9b1b-25964c4358e8 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:46.388559 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-084279f3-e57d-4634-9b1b-25964c4358e8 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:46.395610 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-084279f3-e57d-4634-9b1b-25964c4358e8 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:46.396267 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-084279f3-e57d-4634-9b1b-25964c4358e8 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:46.397379 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-084279f3-e57d-4634-9b1b-25964c4358e8 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:46.397946 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-084279f3-e57d-4634-9b1b-25964c4358e8 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:46.572720 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-084279f3-e57d-4634-9b1b-25964c4358e8 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:46.581109 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-084279f3-e57d-4634-9b1b-25964c4358e8 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1572 microversion: 2.1 time: 0.198500 May 26 16:48:46.581700 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 353/709] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:48:46 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1572 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:48:47.599688 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-c95fa61b-84f9-4775-877f-0a5868aba0e0 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:47.600405 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-c95fa61b-84f9-4775-877f-0a5868aba0e0 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:47.608695 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c95fa61b-84f9-4775-877f-0a5868aba0e0 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:47.609451 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c95fa61b-84f9-4775-877f-0a5868aba0e0 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:47.610461 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c95fa61b-84f9-4775-877f-0a5868aba0e0 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:47.611395 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c95fa61b-84f9-4775-877f-0a5868aba0e0 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:47.662295 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-a96be598-959d-4126-9317-997cb08229d7 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:47.662891 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-a96be598-959d-4126-9317-997cb08229d7 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:47.671582 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a96be598-959d-4126-9317-997cb08229d7 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:47.672022 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a96be598-959d-4126-9317-997cb08229d7 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:47.672861 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a96be598-959d-4126-9317-997cb08229d7 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:47.673285 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a96be598-959d-4126-9317-997cb08229d7 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:47.748418 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c95fa61b-84f9-4775-877f-0a5868aba0e0 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:47.752503 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:47.758334 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-c95fa61b-84f9-4775-877f-0a5868aba0e0 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1572 microversion: 2.1 time: 0.163409 May 26 16:48:47.758558 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:47.758920 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 357/710] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:48:47 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1572 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:48:47.763044 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.objects.instance [None req-a96be598-959d-4126-9317-997cb08229d7 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lazy-loading 'services' on Instance uuid 6a780ece-54a3-4348-a484-8cc1fd983934 {{(pid=124267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:48:47.843160 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-a96be598-959d-4126-9317-997cb08229d7 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "DELETE /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934/os-volume_attachments/0f7cea50-f290-429b-b903-b729aed245c2" status: 202 len: 0 microversion: 2.1 time: 0.184750 May 26 16:48:47.847379 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 354/711] 10.222.0.102 () {58 vars in 1420 bytes} [Thu May 26 16:48:47 2022] DELETE /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934/os-volume_attachments/0f7cea50-f290-429b-b903-b729aed245c2 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 16:48:47.852939 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-80388eb4-fc54-46d1-8f01-5e939b960167 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:47.853810 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-80388eb4-fc54-46d1-8f01-5e939b960167 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:47.869118 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-80388eb4-fc54-46d1-8f01-5e939b960167 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:47.869554 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-80388eb4-fc54-46d1-8f01-5e939b960167 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:47.870346 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-80388eb4-fc54-46d1-8f01-5e939b960167 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:47.870783 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-80388eb4-fc54-46d1-8f01-5e939b960167 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:47.903290 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-80388eb4-fc54-46d1-8f01-5e939b960167 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054262 May 26 16:48:47.903868 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 358/712] 10.222.0.102 () {58 vars in 1306 bytes} [Thu May 26 16:48:47 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:48:48.777128 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-41565aa5-87b6-4063-b1f3-de1cd2d38ff9 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:48.777822 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-41565aa5-87b6-4063-b1f3-de1cd2d38ff9 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:48.785592 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-41565aa5-87b6-4063-b1f3-de1cd2d38ff9 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:48.786037 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-41565aa5-87b6-4063-b1f3-de1cd2d38ff9 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:48.786806 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-41565aa5-87b6-4063-b1f3-de1cd2d38ff9 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:48.787353 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-41565aa5-87b6-4063-b1f3-de1cd2d38ff9 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:48.915696 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1442abf9-56ec-4ac6-9ac4-eaef425bdc0c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:48.916702 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1442abf9-56ec-4ac6-9ac4-eaef425bdc0c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:48.923496 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1442abf9-56ec-4ac6-9ac4-eaef425bdc0c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:48.923951 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1442abf9-56ec-4ac6-9ac4-eaef425bdc0c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:48.924529 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-41565aa5-87b6-4063-b1f3-de1cd2d38ff9 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:48.924760 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1442abf9-56ec-4ac6-9ac4-eaef425bdc0c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:48.925201 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1442abf9-56ec-4ac6-9ac4-eaef425bdc0c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:48.933370 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-41565aa5-87b6-4063-b1f3-de1cd2d38ff9 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1572 microversion: 2.1 time: 0.160806 May 26 16:48:48.933960 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 355/713] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:48:48 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1572 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:48:48.958378 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1442abf9-56ec-4ac6-9ac4-eaef425bdc0c tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046864 May 26 16:48:48.958941 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 359/714] 10.222.0.102 () {58 vars in 1306 bytes} [Thu May 26 16:48:48 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:48:49.951514 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-07ef4357-2f29-4c2a-9348-786598b20a28 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:49.952210 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-07ef4357-2f29-4c2a-9348-786598b20a28 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:49.959920 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-07ef4357-2f29-4c2a-9348-786598b20a28 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:49.960444 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-07ef4357-2f29-4c2a-9348-786598b20a28 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:49.961405 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-07ef4357-2f29-4c2a-9348-786598b20a28 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:49.962078 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-07ef4357-2f29-4c2a-9348-786598b20a28 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:49.971009 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-337443af-4cc1-4592-8f48-fa814b840ec5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:49.971944 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-337443af-4cc1-4592-8f48-fa814b840ec5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:49.974311 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:49.979832 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-337443af-4cc1-4592-8f48-fa814b840ec5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:49.980290 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-337443af-4cc1-4592-8f48-fa814b840ec5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:49.981098 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-337443af-4cc1-4592-8f48-fa814b840ec5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:49.981544 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-337443af-4cc1-4592-8f48-fa814b840ec5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:50.017160 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-337443af-4cc1-4592-8f48-fa814b840ec5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050759 May 26 16:48:50.018062 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 360/715] 10.222.0.102 () {58 vars in 1306 bytes} [Thu May 26 16:48:49 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 16:48:50.111734 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0265b03e-15d8-4770-bcd5-b468ae4a1765 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:50.112228 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0265b03e-15d8-4770-bcd5-b468ae4a1765 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:50.116253 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-07ef4357-2f29-4c2a-9348-786598b20a28 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:50.118586 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0265b03e-15d8-4770-bcd5-b468ae4a1765 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:50.119033 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0265b03e-15d8-4770-bcd5-b468ae4a1765 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:50.119800 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0265b03e-15d8-4770-bcd5-b468ae4a1765 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:50.120386 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0265b03e-15d8-4770-bcd5-b468ae4a1765 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:50.124913 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-07ef4357-2f29-4c2a-9348-786598b20a28 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1572 microversion: 2.1 time: 0.177109 May 26 16:48:50.125513 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 356/716] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:48:49 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1572 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:48:50.147009 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0265b03e-15d8-4770-bcd5-b468ae4a1765 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Going to try to terminate instance {{(pid=124266) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 16:48:50.228318 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0265b03e-15d8-4770-bcd5-b468ae4a1765 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "DELETE /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 204 len: 0 microversion: 2.1 time: 0.120131 May 26 16:48:50.229221 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 361/717] 10.222.0.102 () {58 vars in 1243 bytes} [Thu May 26 16:48:50 2022] DELETE /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 16:48:50.237166 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-e9cef8e1-fb47-4ef1-9007-10238e4de8fd tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:50.237766 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-e9cef8e1-fb47-4ef1-9007-10238e4de8fd tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:50.239830 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:50.249772 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e9cef8e1-fb47-4ef1-9007-10238e4de8fd tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:50.250803 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e9cef8e1-fb47-4ef1-9007-10238e4de8fd tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:50.252265 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e9cef8e1-fb47-4ef1-9007-10238e4de8fd tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:50.253106 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e9cef8e1-fb47-4ef1-9007-10238e4de8fd tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:50.425036 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-e9cef8e1-fb47-4ef1-9007-10238e4de8fd tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:50.432561 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-e9cef8e1-fb47-4ef1-9007-10238e4de8fd tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1691 microversion: 2.1 time: 0.199193 May 26 16:48:50.433139 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 357/718] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:48:50 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1691 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:48:51.143294 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-aaeca553-a47d-4218-8794-f71447f1c7e7 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:51.143998 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-aaeca553-a47d-4218-8794-f71447f1c7e7 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:51.150738 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-aaeca553-a47d-4218-8794-f71447f1c7e7 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:51.151189 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-aaeca553-a47d-4218-8794-f71447f1c7e7 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:51.151974 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-aaeca553-a47d-4218-8794-f71447f1c7e7 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:51.152437 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-aaeca553-a47d-4218-8794-f71447f1c7e7 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:51.297593 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-aaeca553-a47d-4218-8794-f71447f1c7e7 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:51.305904 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-aaeca553-a47d-4218-8794-f71447f1c7e7 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1572 microversion: 2.1 time: 0.166848 May 26 16:48:51.306478 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 362/719] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:48:51 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1572 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:48:51.450480 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-bbb2977d-4d43-4bec-b640-28dee9f86ce3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:51.451052 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-bbb2977d-4d43-4bec-b640-28dee9f86ce3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:51.457798 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bbb2977d-4d43-4bec-b640-28dee9f86ce3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:51.458246 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bbb2977d-4d43-4bec-b640-28dee9f86ce3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:51.459236 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bbb2977d-4d43-4bec-b640-28dee9f86ce3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:51.459665 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bbb2977d-4d43-4bec-b640-28dee9f86ce3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:51.601979 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-bbb2977d-4d43-4bec-b640-28dee9f86ce3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:51.609749 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-bbb2977d-4d43-4bec-b640-28dee9f86ce3 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1691 microversion: 2.1 time: 0.163136 May 26 16:48:51.610356 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 358/720] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:48:51 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:48:52.323563 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3e972ad4-803d-44ea-a71f-b20f7097bb7d tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:52.324238 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-3e972ad4-803d-44ea-a71f-b20f7097bb7d tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:52.331713 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3e972ad4-803d-44ea-a71f-b20f7097bb7d tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:52.332177 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3e972ad4-803d-44ea-a71f-b20f7097bb7d tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:52.333003 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3e972ad4-803d-44ea-a71f-b20f7097bb7d tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:52.333448 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3e972ad4-803d-44ea-a71f-b20f7097bb7d tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:52.469832 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3e972ad4-803d-44ea-a71f-b20f7097bb7d tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:52.477942 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-3e972ad4-803d-44ea-a71f-b20f7097bb7d tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1572 microversion: 2.1 time: 0.158385 May 26 16:48:52.478505 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 363/721] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:48:52 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1572 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:48:52.627898 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-5b46248d-b09b-4a94-8c4a-ed8f50827991 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:52.628444 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-5b46248d-b09b-4a94-8c4a-ed8f50827991 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:52.635137 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-5b46248d-b09b-4a94-8c4a-ed8f50827991 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:52.635576 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-5b46248d-b09b-4a94-8c4a-ed8f50827991 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:52.636346 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-5b46248d-b09b-4a94-8c4a-ed8f50827991 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:52.636806 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-5b46248d-b09b-4a94-8c4a-ed8f50827991 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:52.772349 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-5b46248d-b09b-4a94-8c4a-ed8f50827991 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:52.785629 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-5b46248d-b09b-4a94-8c4a-ed8f50827991 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1691 microversion: 2.1 time: 0.161822 May 26 16:48:52.786708 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 359/722] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:48:52 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:48:53.495680 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a288d463-bbe4-4c5c-8400-78e55d8c2972 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:53.496298 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a288d463-bbe4-4c5c-8400-78e55d8c2972 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:53.503276 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a288d463-bbe4-4c5c-8400-78e55d8c2972 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:53.503729 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a288d463-bbe4-4c5c-8400-78e55d8c2972 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:53.504518 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a288d463-bbe4-4c5c-8400-78e55d8c2972 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:53.504959 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a288d463-bbe4-4c5c-8400-78e55d8c2972 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:53.636750 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a288d463-bbe4-4c5c-8400-78e55d8c2972 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:53.645036 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a288d463-bbe4-4c5c-8400-78e55d8c2972 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1572 microversion: 2.1 time: 0.153277 May 26 16:48:53.645607 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 364/723] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:48:53 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1572 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:48:53.803750 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-0e9d2a1a-f753-46e2-b35f-2f1c923e5485 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:53.804433 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-0e9d2a1a-f753-46e2-b35f-2f1c923e5485 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:53.811290 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0e9d2a1a-f753-46e2-b35f-2f1c923e5485 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:53.811746 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0e9d2a1a-f753-46e2-b35f-2f1c923e5485 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:53.814455 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0e9d2a1a-f753-46e2-b35f-2f1c923e5485 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:53.814455 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0e9d2a1a-f753-46e2-b35f-2f1c923e5485 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:53.968692 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-0e9d2a1a-f753-46e2-b35f-2f1c923e5485 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:53.977446 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-0e9d2a1a-f753-46e2-b35f-2f1c923e5485 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1691 microversion: 2.1 time: 0.177996 May 26 16:48:53.978124 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 360/724] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:48:53 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1691 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:48:54.662036 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e6b84c6f-d7b5-4756-9045-9dc1a6a77142 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:54.662665 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e6b84c6f-d7b5-4756-9045-9dc1a6a77142 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:54.669148 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e6b84c6f-d7b5-4756-9045-9dc1a6a77142 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:54.669599 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e6b84c6f-d7b5-4756-9045-9dc1a6a77142 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:54.670370 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e6b84c6f-d7b5-4756-9045-9dc1a6a77142 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:54.670810 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e6b84c6f-d7b5-4756-9045-9dc1a6a77142 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:54.805135 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e6b84c6f-d7b5-4756-9045-9dc1a6a77142 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:54.813013 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e6b84c6f-d7b5-4756-9045-9dc1a6a77142 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1572 microversion: 2.1 time: 0.155488 May 26 16:48:54.813615 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 365/725] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:48:54 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1572 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:48:54.995088 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-44db3450-171e-4b16-9261-e290da58d5c1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:54.995793 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-44db3450-171e-4b16-9261-e290da58d5c1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:55.002745 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-44db3450-171e-4b16-9261-e290da58d5c1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:55.003197 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-44db3450-171e-4b16-9261-e290da58d5c1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:55.003995 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-44db3450-171e-4b16-9261-e290da58d5c1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:55.004589 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-44db3450-171e-4b16-9261-e290da58d5c1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:55.232982 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-44db3450-171e-4b16-9261-e290da58d5c1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:55.241620 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-44db3450-171e-4b16-9261-e290da58d5c1 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1691 microversion: 2.1 time: 0.250268 May 26 16:48:55.252405 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 361/726] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:48:54 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1691 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:48:55.785604 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-ca62a39b-4562-4285-be33-e6180219827d req-2d627e48-3b77-4bd7-9ffe-3cd52901d3dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a780ece-54a3-4348-a484-8cc1fd983934", "name": "network-vif-deleted", "tag": "f73f919a-97c7-4339-b316-1192335f4fa0"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:48:55.799070 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-ca62a39b-4562-4285-be33-e6180219827d req-2d627e48-3b77-4bd7-9ffe-3cd52901d3dd service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:55.799530 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-ca62a39b-4562-4285-be33-e6180219827d req-2d627e48-3b77-4bd7-9ffe-3cd52901d3dd service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:55.813546 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-ca62a39b-4562-4285-be33-e6180219827d req-2d627e48-3b77-4bd7-9ffe-3cd52901d3dd service nova] Creating event network-vif-deleted:f73f919a-97c7-4339-b316-1192335f4fa0 for instance 6a780ece-54a3-4348-a484-8cc1fd983934 on hv-cinder-83607 May 26 16:48:55.818936 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-ca62a39b-4562-4285-be33-e6180219827d req-2d627e48-3b77-4bd7-9ffe-3cd52901d3dd service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037302 May 26 16:48:55.819539 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 366/727] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:48:55.830810 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-d9920beb-d730-4a04-b496-b5e58024f19d tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:55.831660 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-d9920beb-d730-4a04-b496-b5e58024f19d tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:55.837694 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d9920beb-d730-4a04-b496-b5e58024f19d tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:55.838400 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d9920beb-d730-4a04-b496-b5e58024f19d tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:55.839592 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d9920beb-d730-4a04-b496-b5e58024f19d tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:55.840219 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d9920beb-d730-4a04-b496-b5e58024f19d tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:56.024290 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-d9920beb-d730-4a04-b496-b5e58024f19d tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:56.042328 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-d9920beb-d730-4a04-b496-b5e58024f19d tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1572 microversion: 2.1 time: 0.215443 May 26 16:48:56.045552 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 362/728] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:48:55 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1572 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:48:56.261850 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9c3dd3ed-3eac-4ce9-9192-879df8bf81cd tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:56.262559 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9c3dd3ed-3eac-4ce9-9192-879df8bf81cd tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:56.269857 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9c3dd3ed-3eac-4ce9-9192-879df8bf81cd tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:56.270315 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9c3dd3ed-3eac-4ce9-9192-879df8bf81cd tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:56.271094 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9c3dd3ed-3eac-4ce9-9192-879df8bf81cd tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:56.271536 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9c3dd3ed-3eac-4ce9-9192-879df8bf81cd tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:56.306983 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9c3dd3ed-3eac-4ce9-9192-879df8bf81cd tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:56.307541 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9c3dd3ed-3eac-4ce9-9192-879df8bf81cd tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:56.307997 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.objects.instance [None req-9c3dd3ed-3eac-4ce9-9192-879df8bf81cd tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lazy-loading 'fault' on Instance uuid 6a780ece-54a3-4348-a484-8cc1fd983934 {{(pid=124266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:48:56.353298 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9c3dd3ed-3eac-4ce9-9192-879df8bf81cd tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:56.361138 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9c3dd3ed-3eac-4ce9-9192-879df8bf81cd tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 200 len: 1339 microversion: 2.1 time: 0.103438 May 26 16:48:56.362482 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 367/729] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:48:56 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 1339 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:48:57.063058 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-bf60da86-7609-472d-926a-e5b00c240b99 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:57.063673 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-bf60da86-7609-472d-926a-e5b00c240b99 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:57.071318 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bf60da86-7609-472d-926a-e5b00c240b99 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:57.071771 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bf60da86-7609-472d-926a-e5b00c240b99 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:57.072588 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bf60da86-7609-472d-926a-e5b00c240b99 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:57.073027 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bf60da86-7609-472d-926a-e5b00c240b99 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:57.217903 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-bf60da86-7609-472d-926a-e5b00c240b99 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:57.226488 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-bf60da86-7609-472d-926a-e5b00c240b99 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1572 microversion: 2.1 time: 0.167657 May 26 16:48:57.227073 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 363/730] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:48:57 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1572 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:48:57.378577 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1c6de3c8-c412-4572-be23-79faaf7cb0a6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:57.379170 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1c6de3c8-c412-4572-be23-79faaf7cb0a6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a780ece-54a3-4348-a484-8cc1fd983934] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:57.385819 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1c6de3c8-c412-4572-be23-79faaf7cb0a6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:57.386275 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1c6de3c8-c412-4572-be23-79faaf7cb0a6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:57.387051 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1c6de3c8-c412-4572-be23-79faaf7cb0a6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:57.387493 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1c6de3c8-c412-4572-be23-79faaf7cb0a6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:57.401566 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-1c6de3c8-c412-4572-be23-79faaf7cb0a6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] HTTP exception thrown: Instance 6a780ece-54a3-4348-a484-8cc1fd983934 could not be found. May 26 16:48:57.403254 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1c6de3c8-c412-4572-be23-79faaf7cb0a6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Request method failure captured: May 26 16:48:57.403254 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 HTTP/1.1 May 26 16:48:57.403254 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept: application/json May 26 16:48:57.403254 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity May 26 16:48:57.403254 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Connection: close May 26 16:48:57.403254 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Length: 0 May 26 16:48:57.403254 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Type: application/json May 26 16:48:57.403254 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Host: 10.222.0.102 May 26 16:48:57.403254 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None May 26 16:48:57.403254 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 May 26 16:48:57.403254 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABij62o9giAUjK9QPbUFbwFo-FgFlOy7dIdimEDaohYi-sKTCdB1x5HtixELEAzUkpBuerDG9JUdHvExIjWA4U-cGIqZbLgDVo_-1KrAr5aGX22qLivGdFGb8QTOdP7EHcYJDUTZmj-LaOBh6ZTeQxUKquK1A4-AFQYG9aL6_6JaqjZXrQ May 26 16:48:57.403254 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Id: None May 26 16:48:57.403254 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Name: None May 26 16:48:57.403254 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed May 26 16:48:57.403254 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True May 26 16:48:57.403254 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default May 26 16:48:57.403254 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default May 26 16:48:57.403254 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Id: a85ded3a20964dbbbc354199f5129d9b May 26 16:48:57.403254 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1592668870 May 26 16:48:57.403254 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Role: reader,member May 26 16:48:57.403254 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Roles: reader,member May 26 16:48:57.405677 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/a85ded3a20964dbbbc354199f5129d9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/a85ded3a20964dbbbc354199f5129d9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/a85ded3a20964dbbbc354199f5129d9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_a85ded3a20964dbbbc354199f5129d9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:48:57.405677 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1592668870 May 26 16:48:57.405677 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Id: a85ded3a20964dbbbc354199f5129d9b May 26 16:48:57.405677 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1592668870 May 26 16:48:57.405677 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User: tempest-ServerRescueNegativeTestJSON-1592668870-project May 26 16:48:57.405677 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default May 26 16:48:57.405677 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default May 26 16:48:57.405677 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Id: 9330e65e73394f18b87c5b1d5d47f564 May 26 16:48:57.405677 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1592668870-project May 26 16:48:57.405677 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: method: > May 26 16:48:57.405677 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: exception: Instance 6a780ece-54a3-4348-a484-8cc1fd983934 could not be found. May 26 16:48:57.405677 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: action_args: {'id': '6a780ece-54a3-4348-a484-8cc1fd983934'} May 26 16:48:57.406824 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:48:57.406824 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:48:57.406824 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:48:57.406824 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:48:57.406824 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:48:57.406824 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:48:57.406824 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:48:57.406824 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:48:57.406824 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:48:57.406824 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:48:57.406824 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a780ece-54a3-4348-a484-8cc1fd983934 could not be found. May 26 16:48:57.406824 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:48:57.406824 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:48:57.406824 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:48:57.406824 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:48:57.406824 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:48:57.406824 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:48:57.406824 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:48:57.406824 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:48:57.406824 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:48:57.409509 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:48:57.409509 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 16:48:57.409509 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 16:48:57.409509 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:48:57.409509 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:48:57.409509 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:48:57.409509 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:48:57.409509 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a780ece-54a3-4348-a484-8cc1fd983934 could not be found. May 26 16:48:57.409509 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:48:57.409509 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:48:57.409509 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:48:57.409509 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:48:57.409509 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:48:57.409509 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:48:57.409509 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:48:57.409509 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:48:57.409509 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a780ece-54a3-4348-a484-8cc1fd983934 could not be found. May 26 16:48:57.409509 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:48:57.411863 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1c6de3c8-c412-4572-be23-79faaf7cb0a6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Returning 404 to user: Instance 6a780ece-54a3-4348-a484-8cc1fd983934 could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:48:57.411863 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1c6de3c8-c412-4572-be23-79faaf7cb0a6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934" status: 404 len: 111 microversion: 2.1 time: 0.030008 May 26 16:48:57.411863 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 368/731] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:48:57 2022] GET /compute/v2.1/servers/6a780ece-54a3-4348-a484-8cc1fd983934 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 16:48:57.415659 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-c430d4ba-77b7-4b31-85d5-26bf78277cab tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '.version_select at 0x7f93a3d36ca0>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:57.435214 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-c430d4ba-77b7-4b31-85d5-26bf78277cab tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2003504419" status: 202 len: 0 microversion: 2.1 time: 0.024226 May 26 16:48:57.435787 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 364/732] 10.222.0.102 () {58 vars in 1225 bytes} [Thu May 26 16:48:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2003504419 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 16:48:58.244354 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-dc998596-0832-4ba6-b1f3-109e94bdf34e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:58.245074 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-dc998596-0832-4ba6-b1f3-109e94bdf34e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:58.251043 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dc998596-0832-4ba6-b1f3-109e94bdf34e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:58.252034 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dc998596-0832-4ba6-b1f3-109e94bdf34e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:58.252858 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dc998596-0832-4ba6-b1f3-109e94bdf34e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:58.253303 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dc998596-0832-4ba6-b1f3-109e94bdf34e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:58.396128 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-dc998596-0832-4ba6-b1f3-109e94bdf34e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:58.403748 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-dc998596-0832-4ba6-b1f3-109e94bdf34e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1572 microversion: 2.1 time: 0.163465 May 26 16:48:58.404303 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 369/733] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:48:58 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1572 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:48:59.090267 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-32aa72fa-0cd2-4d2e-9d0a-dcd5280fe0bb tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-312083356"}} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:48:59.090842 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-32aa72fa-0cd2-4d2e-9d0a-dcd5280fe0bb tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:59.097493 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-32aa72fa-0cd2-4d2e-9d0a-dcd5280fe0bb tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:59.097935 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-32aa72fa-0cd2-4d2e-9d0a-dcd5280fe0bb tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:59.098754 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-32aa72fa-0cd2-4d2e-9d0a-dcd5280fe0bb tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:59.099189 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-32aa72fa-0cd2-4d2e-9d0a-dcd5280fe0bb tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:59.232967 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.network.security_group_api [None req-32aa72fa-0cd2-4d2e-9d0a-dcd5280fe0bb tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Removing security group 37c75c9d-f08f-4004-ba1d-4128ef73aa3f from port cca18761-4fc8-4413-bdd9-ee704f060a72 May 26 16:48:59.424127 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-90a57cd7-170f-4f95-9901-a2b9015b9ad2 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:59.425473 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-90a57cd7-170f-4f95-9901-a2b9015b9ad2 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:59.435497 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-90a57cd7-170f-4f95-9901-a2b9015b9ad2 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:59.436204 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-90a57cd7-170f-4f95-9901-a2b9015b9ad2 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:59.437269 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-90a57cd7-170f-4f95-9901-a2b9015b9ad2 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:59.437856 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-90a57cd7-170f-4f95-9901-a2b9015b9ad2 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:59.678403 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-90a57cd7-170f-4f95-9901-a2b9015b9ad2 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:48:59.686354 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-90a57cd7-170f-4f95-9901-a2b9015b9ad2 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1573 microversion: 2.1 time: 0.269187 May 26 16:48:59.686937 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 370/734] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:48:59 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1573 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:48:59.704919 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d15cfec3-4b80-49c9-993e-1b68765296b9 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:48:59.705866 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d15cfec3-4b80-49c9-993e-1b68765296b9 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:59.712896 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d15cfec3-4b80-49c9-993e-1b68765296b9 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:59.714067 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d15cfec3-4b80-49c9-993e-1b68765296b9 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:59.714214 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d15cfec3-4b80-49c9-993e-1b68765296b9 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:59.714558 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d15cfec3-4b80-49c9-993e-1b68765296b9 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:59.740724 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-32aa72fa-0cd2-4d2e-9d0a-dcd5280fe0bb tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "POST /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8/action" status: 202 len: 0 microversion: 2.1 time: 0.655603 May 26 16:48:59.741379 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 365/735] 10.222.0.102 () {60 vars in 1282 bytes} [Thu May 26 16:48:59 2022] POST /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8/action => generated 0 bytes in 657 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 16:48:59.752089 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-19994d47-1f3a-4ce6-96c4-b5035ab3673d req-b92ddef0-9364-46c6-8aa1-c463438a5c03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b7b9106-8559-47d1-93c5-3549d90ee4f8", "tag": "cca18761-4fc8-4413-bdd9-ee704f060a72"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:48:59.782547 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-19994d47-1f3a-4ce6-96c4-b5035ab3673d req-b92ddef0-9364-46c6-8aa1-c463438a5c03 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:59.783318 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-19994d47-1f3a-4ce6-96c4-b5035ab3673d req-b92ddef0-9364-46c6-8aa1-c463438a5c03 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:59.828845 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-19994d47-1f3a-4ce6-96c4-b5035ab3673d req-b92ddef0-9364-46c6-8aa1-c463438a5c03 service nova] Creating event network-changed:cca18761-4fc8-4413-bdd9-ee704f060a72 for instance 7b7b9106-8559-47d1-93c5-3549d90ee4f8 on hv-cinder-83607 May 26 16:48:59.843299 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-19994d47-1f3a-4ce6-96c4-b5035ab3673d req-b92ddef0-9364-46c6-8aa1-c463438a5c03 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095176 May 26 16:48:59.845389 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 366/736] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:48:59.863046 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d15cfec3-4b80-49c9-993e-1b68765296b9 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "POST /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd/action" status: 202 len: 0 microversion: 2.1 time: 0.162663 May 26 16:48:59.864866 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 371/737] 10.222.0.102 () {60 vars in 1282 bytes} [Thu May 26 16:48:59 2022] POST /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 16:48:59.875479 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-836cabec-27a7-4a75-9c2c-b2cbf060dd85 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:48:59.878607 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-836cabec-27a7-4a75-9c2c-b2cbf060dd85 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:48:59.886639 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-836cabec-27a7-4a75-9c2c-b2cbf060dd85 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:59.887396 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-836cabec-27a7-4a75-9c2c-b2cbf060dd85 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:48:59.889500 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-836cabec-27a7-4a75-9c2c-b2cbf060dd85 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:48:59.890190 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-836cabec-27a7-4a75-9c2c-b2cbf060dd85 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:00.071967 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-836cabec-27a7-4a75-9c2c-b2cbf060dd85 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:00.083063 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-836cabec-27a7-4a75-9c2c-b2cbf060dd85 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1521 microversion: 2.1 time: 0.213754 May 26 16:49:00.083708 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 367/738] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:48:59 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:49:00.607223 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-b7f00c90-1c95-4eb6-8bba-eebb69a3c901 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:00.607940 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-b7f00c90-1c95-4eb6-8bba-eebb69a3c901 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:00.618697 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b7f00c90-1c95-4eb6-8bba-eebb69a3c901 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:00.619260 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b7f00c90-1c95-4eb6-8bba-eebb69a3c901 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:00.620207 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b7f00c90-1c95-4eb6-8bba-eebb69a3c901 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:00.620761 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b7f00c90-1c95-4eb6-8bba-eebb69a3c901 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:00.653103 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-b7f00c90-1c95-4eb6-8bba-eebb69a3c901 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Going to try to terminate instance {{(pid=124266) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 16:49:00.656607 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:00.806265 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-b7f00c90-1c95-4eb6-8bba-eebb69a3c901 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "DELETE /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 204 len: 0 microversion: 2.1 time: 0.203459 May 26 16:49:00.807198 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 372/739] 10.222.0.102 () {58 vars in 1243 bytes} [Thu May 26 16:49:00 2022] DELETE /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 16:49:00.815953 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-291562d5-d05b-4c19-8d34-ff9416f09145 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:00.816767 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-291562d5-d05b-4c19-8d34-ff9416f09145 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:00.826274 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-291562d5-d05b-4c19-8d34-ff9416f09145 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:00.826633 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-291562d5-d05b-4c19-8d34-ff9416f09145 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:00.828107 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-291562d5-d05b-4c19-8d34-ff9416f09145 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:00.828781 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-291562d5-d05b-4c19-8d34-ff9416f09145 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:01.116535 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1010792f-4e86-4101-9c7a-73583d1ca94e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:01.117157 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1010792f-4e86-4101-9c7a-73583d1ca94e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:01.123373 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1010792f-4e86-4101-9c7a-73583d1ca94e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:01.123836 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1010792f-4e86-4101-9c7a-73583d1ca94e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:01.124653 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1010792f-4e86-4101-9c7a-73583d1ca94e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:01.125099 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1010792f-4e86-4101-9c7a-73583d1ca94e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:01.147451 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-291562d5-d05b-4c19-8d34-ff9416f09145 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:01.156753 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-291562d5-d05b-4c19-8d34-ff9416f09145 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1512 microversion: 2.1 time: 0.345405 May 26 16:49:01.159694 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 368/740] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:00 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1512 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:01.386441 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1010792f-4e86-4101-9c7a-73583d1ca94e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:01.395165 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1010792f-4e86-4101-9c7a-73583d1ca94e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1523 microversion: 2.1 time: 0.283559 May 26 16:49:01.395745 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 373/741] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:01 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1523 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:49:01.485552 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-5b15033e-9b08-42ab-9fd9-b338f3ec99a6 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:01.486047 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-5b15033e-9b08-42ab-9fd9-b338f3ec99a6 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:01.492928 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-5b15033e-9b08-42ab-9fd9-b338f3ec99a6 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:01.493631 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-5b15033e-9b08-42ab-9fd9-b338f3ec99a6 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:01.494422 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-5b15033e-9b08-42ab-9fd9-b338f3ec99a6 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:01.494855 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-5b15033e-9b08-42ab-9fd9-b338f3ec99a6 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:01.576825 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.objects.instance [None req-5b15033e-9b08-42ab-9fd9-b338f3ec99a6 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lazy-loading 'services' on Instance uuid 7b7b9106-8559-47d1-93c5-3549d90ee4f8 {{(pid=124267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:49:01.650686 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-5b15033e-9b08-42ab-9fd9-b338f3ec99a6 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "DELETE /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8/os-volume_attachments/82c01545-e4e9-4432-b456-1716a2769a8a" status: 202 len: 0 microversion: 2.1 time: 0.168859 May 26 16:49:01.651496 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 369/742] 10.222.0.102 () {58 vars in 1420 bytes} [Thu May 26 16:49:01 2022] DELETE /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8/os-volume_attachments/82c01545-e4e9-4432-b456-1716a2769a8a => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 16:49:01.661260 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0a7f7b77-497d-4b4f-b8d6-91f34f78e00c tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:01.662334 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0a7f7b77-497d-4b4f-b8d6-91f34f78e00c tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:01.669534 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0a7f7b77-497d-4b4f-b8d6-91f34f78e00c tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:01.670104 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0a7f7b77-497d-4b4f-b8d6-91f34f78e00c tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:01.671185 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0a7f7b77-497d-4b4f-b8d6-91f34f78e00c tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:01.671605 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0a7f7b77-497d-4b4f-b8d6-91f34f78e00c tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:01.709283 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0a7f7b77-497d-4b4f-b8d6-91f34f78e00c tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053163 May 26 16:49:01.710146 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 374/743] 10.222.0.102 () {58 vars in 1306 bytes} [Thu May 26 16:49:01 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:49:01.864167 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-119f33a5-b99a-4bd6-9f4e-3efe5fad0078 req-17533764-7a9f-4c34-8609-51251c74e77c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b7b9106-8559-47d1-93c5-3549d90ee4f8", "tag": "cca18761-4fc8-4413-bdd9-ee704f060a72"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:49:01.873315 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-119f33a5-b99a-4bd6-9f4e-3efe5fad0078 req-17533764-7a9f-4c34-8609-51251c74e77c service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:01.873852 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-119f33a5-b99a-4bd6-9f4e-3efe5fad0078 req-17533764-7a9f-4c34-8609-51251c74e77c service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:01.886052 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-119f33a5-b99a-4bd6-9f4e-3efe5fad0078 req-17533764-7a9f-4c34-8609-51251c74e77c service nova] Creating event network-changed:cca18761-4fc8-4413-bdd9-ee704f060a72 for instance 7b7b9106-8559-47d1-93c5-3549d90ee4f8 on hv-cinder-83607 May 26 16:49:01.891065 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-119f33a5-b99a-4bd6-9f4e-3efe5fad0078 req-17533764-7a9f-4c34-8609-51251c74e77c service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031169 May 26 16:49:01.892219 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 370/744] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:49:02.177532 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-acfd1439-1686-464d-9ce5-bf43c4275fcc tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:02.178958 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-acfd1439-1686-464d-9ce5-bf43c4275fcc tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:02.186081 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-acfd1439-1686-464d-9ce5-bf43c4275fcc tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:02.188317 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-acfd1439-1686-464d-9ce5-bf43c4275fcc tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:02.189782 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-acfd1439-1686-464d-9ce5-bf43c4275fcc tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:02.190229 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-acfd1439-1686-464d-9ce5-bf43c4275fcc tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:02.415419 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-168d48fb-c57b-4318-b3e0-df81258cdbef tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:02.417279 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-168d48fb-c57b-4318-b3e0-df81258cdbef tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:02.425212 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-168d48fb-c57b-4318-b3e0-df81258cdbef tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:02.425923 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-168d48fb-c57b-4318-b3e0-df81258cdbef tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:02.427132 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-168d48fb-c57b-4318-b3e0-df81258cdbef tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:02.427900 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-168d48fb-c57b-4318-b3e0-df81258cdbef tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:02.429444 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-acfd1439-1686-464d-9ce5-bf43c4275fcc tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:02.440670 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-acfd1439-1686-464d-9ce5-bf43c4275fcc tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1512 microversion: 2.1 time: 0.267642 May 26 16:49:02.441269 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 375/745] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:02 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1512 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:02.692070 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-168d48fb-c57b-4318-b3e0-df81258cdbef tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:02.703130 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-168d48fb-c57b-4318-b3e0-df81258cdbef tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1523 microversion: 2.1 time: 0.293937 May 26 16:49:02.704487 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 371/746] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:02 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1523 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:49:02.723630 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a46d0b00-712f-44bd-984e-a0786fe6ff1b tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:02.724614 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a46d0b00-712f-44bd-984e-a0786fe6ff1b tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:02.733212 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a46d0b00-712f-44bd-984e-a0786fe6ff1b tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:02.734133 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a46d0b00-712f-44bd-984e-a0786fe6ff1b tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:02.735122 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a46d0b00-712f-44bd-984e-a0786fe6ff1b tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:02.735986 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a46d0b00-712f-44bd-984e-a0786fe6ff1b tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:02.770699 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a46d0b00-712f-44bd-984e-a0786fe6ff1b tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052089 May 26 16:49:02.771616 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 376/747] 10.222.0.102 () {58 vars in 1306 bytes} [Thu May 26 16:49:02 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:49:02.918850 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-ead4830a-7112-4c4e-8537-44428d99ecbb req-e6459cc4-968a-4222-8b22-073e35d82467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1d7f247-4a0f-43cb-893b-a937419b4c4c", "name": "network-vif-deleted", "tag": "6fd3d120-3db3-487b-bcb0-b0f1546bac7d"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:49:02.928043 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-ead4830a-7112-4c4e-8537-44428d99ecbb req-e6459cc4-968a-4222-8b22-073e35d82467 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:02.928552 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-ead4830a-7112-4c4e-8537-44428d99ecbb req-e6459cc4-968a-4222-8b22-073e35d82467 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:02.944041 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-ead4830a-7112-4c4e-8537-44428d99ecbb req-e6459cc4-968a-4222-8b22-073e35d82467 service nova] Creating event network-vif-deleted:6fd3d120-3db3-487b-bcb0-b0f1546bac7d for instance d1d7f247-4a0f-43cb-893b-a937419b4c4c on hv-cinder-83607 May 26 16:49:02.949570 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-ead4830a-7112-4c4e-8537-44428d99ecbb req-e6459cc4-968a-4222-8b22-073e35d82467 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034813 May 26 16:49:02.950195 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 372/748] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:49:03.134833 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-ad9e617d-6ae6-49b1-9f71-c7554e55e38a req-7e07a2bd-55d5-424f-9c86-b04f6a89cdd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "898074a4-2c24-403a-bdd9-e9809f6375fd", "name": "network-vif-unplugged", "status": "completed", "tag": "a5a3472f-1b24-4c5b-ada9-48c5e198da12"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:49:03.143978 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-ad9e617d-6ae6-49b1-9f71-c7554e55e38a req-7e07a2bd-55d5-424f-9c86-b04f6a89cdd1 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:03.144463 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-ad9e617d-6ae6-49b1-9f71-c7554e55e38a req-7e07a2bd-55d5-424f-9c86-b04f6a89cdd1 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:03.156942 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.compute.server_external_events [req-ad9e617d-6ae6-49b1-9f71-c7554e55e38a req-7e07a2bd-55d5-424f-9c86-b04f6a89cdd1 service nova] Unable to find a host for instance 898074a4-2c24-403a-bdd9-e9809f6375fd. Dropping event network-vif-unplugged {{(pid=124266) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 26 16:49:03.158520 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-ad9e617d-6ae6-49b1-9f71-c7554e55e38a req-7e07a2bd-55d5-424f-9c86-b04f6a89cdd1 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028493 May 26 16:49:03.159393 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 377/749] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 26 16:49:03.461289 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-65124190-7130-4bf8-aa6a-b4bb2ae80708 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:03.462025 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-65124190-7130-4bf8-aa6a-b4bb2ae80708 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:03.469878 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-65124190-7130-4bf8-aa6a-b4bb2ae80708 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:03.470424 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-65124190-7130-4bf8-aa6a-b4bb2ae80708 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:03.471261 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-65124190-7130-4bf8-aa6a-b4bb2ae80708 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:03.471690 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-65124190-7130-4bf8-aa6a-b4bb2ae80708 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:03.498253 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:03.523506 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-65124190-7130-4bf8-aa6a-b4bb2ae80708 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:03.523953 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-65124190-7130-4bf8-aa6a-b4bb2ae80708 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:03.524506 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.objects.instance [None req-65124190-7130-4bf8-aa6a-b4bb2ae80708 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lazy-loading 'fault' on Instance uuid d1d7f247-4a0f-43cb-893b-a937419b4c4c {{(pid=124267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:49:03.572544 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-65124190-7130-4bf8-aa6a-b4bb2ae80708 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:03.580753 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-65124190-7130-4bf8-aa6a-b4bb2ae80708 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 200 len: 1316 microversion: 2.1 time: 0.124854 May 26 16:49:03.581346 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 373/750] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:03 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 1316 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:49:03.722642 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-933afcd9-165a-4cc2-9e23-2a4a084da3b1 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:03.723175 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-933afcd9-165a-4cc2-9e23-2a4a084da3b1 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:03.730052 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-933afcd9-165a-4cc2-9e23-2a4a084da3b1 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:03.730876 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-933afcd9-165a-4cc2-9e23-2a4a084da3b1 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:03.731322 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-933afcd9-165a-4cc2-9e23-2a4a084da3b1 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:03.731764 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-933afcd9-165a-4cc2-9e23-2a4a084da3b1 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:03.783400 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-bfd1bcab-9c43-409b-a126-b51367e46b52 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:03.784346 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-bfd1bcab-9c43-409b-a126-b51367e46b52 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:03.791865 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bfd1bcab-9c43-409b-a126-b51367e46b52 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:03.792313 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bfd1bcab-9c43-409b-a126-b51367e46b52 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:03.793240 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bfd1bcab-9c43-409b-a126-b51367e46b52 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:03.793724 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bfd1bcab-9c43-409b-a126-b51367e46b52 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:03.841465 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-bfd1bcab-9c43-409b-a126-b51367e46b52 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061676 May 26 16:49:03.842752 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 374/751] 10.222.0.102 () {58 vars in 1306 bytes} [Thu May 26 16:49:03 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:49:03.888287 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-933afcd9-165a-4cc2-9e23-2a4a084da3b1 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:03.902759 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-933afcd9-165a-4cc2-9e23-2a4a084da3b1 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1579 microversion: 2.1 time: 0.183827 May 26 16:49:03.903733 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 378/752] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:03 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1579 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:04.598933 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-0d4052f5-8328-4385-af74-ef031047f644 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:04.599337 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-0d4052f5-8328-4385-af74-ef031047f644 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: d1d7f247-4a0f-43cb-893b-a937419b4c4c] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:04.605989 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0d4052f5-8328-4385-af74-ef031047f644 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:04.606537 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0d4052f5-8328-4385-af74-ef031047f644 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:04.607375 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0d4052f5-8328-4385-af74-ef031047f644 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:04.607870 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0d4052f5-8328-4385-af74-ef031047f644 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:04.622393 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.wsgi [None req-0d4052f5-8328-4385-af74-ef031047f644 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] HTTP exception thrown: Instance d1d7f247-4a0f-43cb-893b-a937419b4c4c could not be found. May 26 16:49:04.624073 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-0d4052f5-8328-4385-af74-ef031047f644 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Request method failure captured: May 26 16:49:04.624073 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: request: GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c HTTP/1.1 May 26 16:49:04.624073 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept: application/json May 26 16:49:04.624073 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept-Encoding: identity May 26 16:49:04.624073 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Connection: close May 26 16:49:04.624073 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Length: 0 May 26 16:49:04.624073 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Type: application/json May 26 16:49:04.624073 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Host: 10.222.0.102 May 26 16:49:04.624073 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Openstack-System-Scope: None May 26 16:49:04.624073 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: User-Agent: python-urllib3/1.26.9 May 26 16:49:04.624073 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Auth-Token: gAAAAABij62o9giAUjK9QPbUFbwFo-FgFlOy7dIdimEDaohYi-sKTCdB1x5HtixELEAzUkpBuerDG9JUdHvExIjWA4U-cGIqZbLgDVo_-1KrAr5aGX22qLivGdFGb8QTOdP7EHcYJDUTZmj-LaOBh6ZTeQxUKquK1A4-AFQYG9aL6_6JaqjZXrQ May 26 16:49:04.624073 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Id: None May 26 16:49:04.624073 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Name: None May 26 16:49:04.624073 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Identity-Status: Confirmed May 26 16:49:04.624073 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Is-Admin-Project: True May 26 16:49:04.624073 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Id: default May 26 16:49:04.624073 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Name: Default May 26 16:49:04.624073 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Id: a85ded3a20964dbbbc354199f5129d9b May 26 16:49:04.624073 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1592668870 May 26 16:49:04.624073 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Role: reader,member May 26 16:49:04.624073 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Roles: reader,member May 26 16:49:04.625784 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/a85ded3a20964dbbbc354199f5129d9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/a85ded3a20964dbbbc354199f5129d9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/a85ded3a20964dbbbc354199f5129d9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_a85ded3a20964dbbbc354199f5129d9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:49:04.625784 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1592668870 May 26 16:49:04.625784 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Id: a85ded3a20964dbbbc354199f5129d9b May 26 16:49:04.625784 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1592668870 May 26 16:49:04.625784 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User: tempest-ServerRescueNegativeTestJSON-1592668870-project May 26 16:49:04.625784 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Id: default May 26 16:49:04.625784 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Name: Default May 26 16:49:04.625784 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Id: 9330e65e73394f18b87c5b1d5d47f564 May 26 16:49:04.625784 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1592668870-project May 26 16:49:04.625784 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: method: > May 26 16:49:04.625784 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: exception: Instance d1d7f247-4a0f-43cb-893b-a937419b4c4c could not be found. May 26 16:49:04.625784 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: action_args: {'id': 'd1d7f247-4a0f-43cb-893b-a937419b4c4c'} May 26 16:49:04.630366 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:49:04.630366 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:49:04.630366 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:49:04.630366 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:49:04.630366 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:49:04.630366 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:49:04.630366 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:49:04.630366 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:49:04.630366 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:49:04.630366 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:49:04.630366 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1d7f247-4a0f-43cb-893b-a937419b4c4c could not be found. May 26 16:49:04.630366 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:49:04.630366 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:49:04.630366 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:49:04.630366 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:49:04.630366 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:49:04.630366 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:49:04.630366 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:49:04.630366 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:49:04.630366 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:49:04.631884 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:49:04.631884 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 16:49:04.631884 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 16:49:04.631884 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:49:04.631884 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:49:04.631884 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:49:04.631884 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:49:04.631884 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1d7f247-4a0f-43cb-893b-a937419b4c4c could not be found. May 26 16:49:04.631884 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:49:04.631884 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:49:04.631884 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:49:04.631884 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:49:04.631884 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:49:04.631884 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:49:04.631884 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:49:04.631884 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:49:04.631884 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1d7f247-4a0f-43cb-893b-a937419b4c4c could not be found. May 26 16:49:04.631884 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:49:04.633254 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-0d4052f5-8328-4385-af74-ef031047f644 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Returning 404 to user: Instance d1d7f247-4a0f-43cb-893b-a937419b4c4c could not be found. {{(pid=124267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:49:04.633254 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-0d4052f5-8328-4385-af74-ef031047f644 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c" status: 404 len: 111 microversion: 2.1 time: 0.031139 May 26 16:49:04.633254 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 375/753] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:04 2022] GET /compute/v2.1/servers/d1d7f247-4a0f-43cb-893b-a937419b4c4c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 16:49:04.635083 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-26cc13e8-87b8-4663-88b6-c54f329b2bff tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:04.635589 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-26cc13e8-87b8-4663-88b6-c54f329b2bff tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:04.642866 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-26cc13e8-87b8-4663-88b6-c54f329b2bff tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:04.643317 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-26cc13e8-87b8-4663-88b6-c54f329b2bff tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:04.644870 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-26cc13e8-87b8-4663-88b6-c54f329b2bff tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:04.645429 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-26cc13e8-87b8-4663-88b6-c54f329b2bff tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:04.675154 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-26cc13e8-87b8-4663-88b6-c54f329b2bff tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Going to try to terminate instance {{(pid=124266) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 16:49:04.763057 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-26cc13e8-87b8-4663-88b6-c54f329b2bff tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "DELETE /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 204 len: 0 microversion: 2.1 time: 0.131914 May 26 16:49:04.763827 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 379/754] 10.222.0.102 () {58 vars in 1243 bytes} [Thu May 26 16:49:04 2022] DELETE /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 16:49:04.772747 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-70a8fe21-8a08-44f1-bef4-91a3558aa1b5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:04.773598 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-70a8fe21-8a08-44f1-bef4-91a3558aa1b5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:04.780300 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-70a8fe21-8a08-44f1-bef4-91a3558aa1b5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:04.780853 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-70a8fe21-8a08-44f1-bef4-91a3558aa1b5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:04.781689 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-70a8fe21-8a08-44f1-bef4-91a3558aa1b5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:04.782706 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-70a8fe21-8a08-44f1-bef4-91a3558aa1b5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:04.854466 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9660189e-6dda-4fe1-99e8-62ca4677ca80 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:04.855498 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9660189e-6dda-4fe1-99e8-62ca4677ca80 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:04.862820 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9660189e-6dda-4fe1-99e8-62ca4677ca80 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:04.863281 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9660189e-6dda-4fe1-99e8-62ca4677ca80 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:04.864076 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9660189e-6dda-4fe1-99e8-62ca4677ca80 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:04.864558 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9660189e-6dda-4fe1-99e8-62ca4677ca80 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:04.895894 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9660189e-6dda-4fe1-99e8-62ca4677ca80 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046144 May 26 16:49:04.896512 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 380/755] 10.222.0.102 () {58 vars in 1306 bytes} [Thu May 26 16:49:04 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 16:49:04.906198 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f4de16f8-50b6-4c15-938a-31c3c31851ae tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:04.906764 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f4de16f8-50b6-4c15-938a-31c3c31851ae tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:04.913522 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f4de16f8-50b6-4c15-938a-31c3c31851ae tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:04.915163 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f4de16f8-50b6-4c15-938a-31c3c31851ae tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:04.915163 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f4de16f8-50b6-4c15-938a-31c3c31851ae tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:04.915512 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f4de16f8-50b6-4c15-938a-31c3c31851ae tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:04.926045 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-70a8fe21-8a08-44f1-bef4-91a3558aa1b5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:04.934596 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-70a8fe21-8a08-44f1-bef4-91a3558aa1b5 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1524 microversion: 2.1 time: 0.166747 May 26 16:49:04.935177 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 376/756] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:04 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1524 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:49:04.949254 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-98112672-4822-427e-ba25-ebaa6c25af2e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:04.949866 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-98112672-4822-427e-ba25-ebaa6c25af2e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:04.956106 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-98112672-4822-427e-ba25-ebaa6c25af2e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:04.957261 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-98112672-4822-427e-ba25-ebaa6c25af2e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:04.958072 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-98112672-4822-427e-ba25-ebaa6c25af2e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:04.958495 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-98112672-4822-427e-ba25-ebaa6c25af2e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:05.043412 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-f4de16f8-50b6-4c15-938a-31c3c31851ae tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] HTTP exception thrown: Instance 7b7b9106-8559-47d1-93c5-3549d90ee4f8 is not attached to volume 82c01545-e4e9-4432-b456-1716a2769a8a May 26 16:49:05.049587 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f4de16f8-50b6-4c15-938a-31c3c31851ae tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Request method failure captured: May 26 16:49:05.049587 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: request: DELETE /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8/os-volume_attachments/82c01545-e4e9-4432-b456-1716a2769a8a HTTP/1.1 May 26 16:49:05.049587 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept: application/json May 26 16:49:05.049587 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity May 26 16:49:05.049587 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Connection: close May 26 16:49:05.049587 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Length: 0 May 26 16:49:05.049587 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Type: application/json May 26 16:49:05.049587 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Host: 10.222.0.102 May 26 16:49:05.049587 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None May 26 16:49:05.049587 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 May 26 16:49:05.049587 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABij65rILUTYt3AicdOZiE9Hcto5PmVJiqf-huCpwTlocMtGnlBjVmxio0dWQ_O85ubmsLmx4x_9qE_1HzRBaEm8roiNgmqjMOOg2153zgr1c62vdxA3pxTj4uLywuJMQ43xx07ntinv_i1MfymedwZnljMdYuQ2YFZpI67C_Yabg96P78 May 26 16:49:05.049587 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Id: None May 26 16:49:05.049587 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Name: None May 26 16:49:05.049587 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed May 26 16:49:05.049587 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True May 26 16:49:05.049587 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default May 26 16:49:05.049587 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default May 26 16:49:05.049587 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Id: 7fa63b33258040739dd6367d959c2250 May 26 16:49:05.049587 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-TestMinimumBasicScenario-200688835 May 26 16:49:05.049587 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Role: reader,member May 26 16:49:05.049587 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Roles: reader,member May 26 16:49:05.052439 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/7fa63b33258040739dd6367d959c2250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/7fa63b33258040739dd6367d959c2250"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/7fa63b33258040739dd6367d959c2250"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_7fa63b33258040739dd6367d959c2250"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:49:05.052439 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-TestMinimumBasicScenario-200688835 May 26 16:49:05.052439 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Id: 7fa63b33258040739dd6367d959c2250 May 26 16:49:05.052439 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-TestMinimumBasicScenario-200688835 May 26 16:49:05.052439 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User: tempest-TestMinimumBasicScenario-200688835-project May 26 16:49:05.052439 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default May 26 16:49:05.052439 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default May 26 16:49:05.052439 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Id: bb976c109cca488aa7317c71b54e5002 May 26 16:49:05.052439 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-TestMinimumBasicScenario-200688835-project May 26 16:49:05.052439 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: method: > May 26 16:49:05.052439 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: exception: Instance 7b7b9106-8559-47d1-93c5-3549d90ee4f8 is not attached to volume 82c01545-e4e9-4432-b456-1716a2769a8a May 26 16:49:05.053867 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: action_args: {'server_id': '7b7b9106-8559-47d1-93c5-3549d90ee4f8', 'id': '82c01545-e4e9-4432-b456-1716a2769a8a'} May 26 16:49:05.053867 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:49:05.053867 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:49:05.053867 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 26 16:49:05.053867 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 26 16:49:05.053867 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 16:49:05.053867 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 16:49:05.053867 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 26 16:49:05.053867 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 26 16:49:05.053867 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 82c01545-e4e9-4432-b456-1716a2769a8a. May 26 16:49:05.053867 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:49:05.053867 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:49:05.053867 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:49:05.053867 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:49:05.053867 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:49:05.053867 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:49:05.053867 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:49:05.053867 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:49:05.053867 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:49:05.056123 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:49:05.056123 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 26 16:49:05.056123 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 26 16:49:05.056123 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b7b9106-8559-47d1-93c5-3549d90ee4f8 is not attached to volume 82c01545-e4e9-4432-b456-1716a2769a8a May 26 16:49:05.056123 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:49:05.056123 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:49:05.056123 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:49:05.056123 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:49:05.056123 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:49:05.056123 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:49:05.056123 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:49:05.056123 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:49:05.056123 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b7b9106-8559-47d1-93c5-3549d90ee4f8 is not attached to volume 82c01545-e4e9-4432-b456-1716a2769a8a May 26 16:49:05.056123 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:49:05.056123 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f4de16f8-50b6-4c15-938a-31c3c31851ae tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Returning 404 to user: Instance 7b7b9106-8559-47d1-93c5-3549d90ee4f8 is not attached to volume 82c01545-e4e9-4432-b456-1716a2769a8a {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:49:05.058002 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f4de16f8-50b6-4c15-938a-31c3c31851ae tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "DELETE /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8/os-volume_attachments/82c01545-e4e9-4432-b456-1716a2769a8a" status: 404 len: 154 microversion: 2.1 time: 0.149186 May 26 16:49:05.058002 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 381/757] 10.222.0.102 () {58 vars in 1420 bytes} [Thu May 26 16:49:04 2022] DELETE /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8/os-volume_attachments/82c01545-e4e9-4432-b456-1716a2769a8a => generated 154 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 16:49:05.122319 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-98112672-4822-427e-ba25-ebaa6c25af2e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:05.130943 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-98112672-4822-427e-ba25-ebaa6c25af2e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1579 microversion: 2.1 time: 0.185327 May 26 16:49:05.131900 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 377/758] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:04 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1579 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:05.952426 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3f20af08-f18d-4741-94bd-eb64d663d23e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:05.953069 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-3f20af08-f18d-4741-94bd-eb64d663d23e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:05.960086 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3f20af08-f18d-4741-94bd-eb64d663d23e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:05.960600 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3f20af08-f18d-4741-94bd-eb64d663d23e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:05.963148 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3f20af08-f18d-4741-94bd-eb64d663d23e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:05.963616 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3f20af08-f18d-4741-94bd-eb64d663d23e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:06.121690 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3f20af08-f18d-4741-94bd-eb64d663d23e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:06.130194 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-3f20af08-f18d-4741-94bd-eb64d663d23e tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1524 microversion: 2.1 time: 0.181960 May 26 16:49:06.130810 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 382/759] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:05 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1524 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:06.149793 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-d2ab748d-b5d0-4268-ba44-2a47597d325b tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:06.150804 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-d2ab748d-b5d0-4268-ba44-2a47597d325b tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:06.157839 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d2ab748d-b5d0-4268-ba44-2a47597d325b tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:06.158288 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d2ab748d-b5d0-4268-ba44-2a47597d325b tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:06.159063 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d2ab748d-b5d0-4268-ba44-2a47597d325b tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:06.159494 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d2ab748d-b5d0-4268-ba44-2a47597d325b tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:06.231915 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ca25b50c-9c0f-4216-b2d4-20b40e4f27e0 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:06.232440 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ca25b50c-9c0f-4216-b2d4-20b40e4f27e0 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:06.240353 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ca25b50c-9c0f-4216-b2d4-20b40e4f27e0 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:06.240964 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ca25b50c-9c0f-4216-b2d4-20b40e4f27e0 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:06.241756 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ca25b50c-9c0f-4216-b2d4-20b40e4f27e0 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:06.242187 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ca25b50c-9c0f-4216-b2d4-20b40e4f27e0 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:06.277623 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ca25b50c-9c0f-4216-b2d4-20b40e4f27e0 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Going to try to terminate instance {{(pid=124266) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 16:49:06.382201 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-d2ab748d-b5d0-4268-ba44-2a47597d325b tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:06.393904 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-d2ab748d-b5d0-4268-ba44-2a47597d325b tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1579 microversion: 2.1 time: 0.248605 May 26 16:49:06.395538 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 378/760] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:06 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1579 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:06.413844 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ca25b50c-9c0f-4216-b2d4-20b40e4f27e0 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "DELETE /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 204 len: 0 microversion: 2.1 time: 0.185038 May 26 16:49:06.415975 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 383/761] 10.222.0.102 () {58 vars in 1243 bytes} [Thu May 26 16:49:06 2022] DELETE /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 16:49:06.432163 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-e1fb64f9-2554-45d1-8964-01a0561f3bbe tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:06.433370 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-e1fb64f9-2554-45d1-8964-01a0561f3bbe tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:06.444798 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e1fb64f9-2554-45d1-8964-01a0561f3bbe tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:06.445591 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e1fb64f9-2554-45d1-8964-01a0561f3bbe tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:06.446984 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e1fb64f9-2554-45d1-8964-01a0561f3bbe tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:06.447779 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e1fb64f9-2554-45d1-8964-01a0561f3bbe tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:06.600497 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-e1fb64f9-2554-45d1-8964-01a0561f3bbe tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:06.608480 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-e1fb64f9-2554-45d1-8964-01a0561f3bbe tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1558 microversion: 2.1 time: 0.185276 May 26 16:49:06.609085 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 379/762] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:06 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1558 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:07.148184 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ae2d1d8a-b717-4432-8d6b-52b0c3c942f0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:07.148850 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ae2d1d8a-b717-4432-8d6b-52b0c3c942f0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:07.155662 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ae2d1d8a-b717-4432-8d6b-52b0c3c942f0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:07.156125 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ae2d1d8a-b717-4432-8d6b-52b0c3c942f0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:07.156954 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ae2d1d8a-b717-4432-8d6b-52b0c3c942f0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:07.157903 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ae2d1d8a-b717-4432-8d6b-52b0c3c942f0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:07.303639 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ae2d1d8a-b717-4432-8d6b-52b0c3c942f0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:07.313233 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ae2d1d8a-b717-4432-8d6b-52b0c3c942f0 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1524 microversion: 2.1 time: 0.169315 May 26 16:49:07.313819 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 384/763] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:07 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1524 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:07.415358 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-531e3d8c-065e-490f-aa1e-42ae90be456d tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:07.416617 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-531e3d8c-065e-490f-aa1e-42ae90be456d tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:07.424256 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-531e3d8c-065e-490f-aa1e-42ae90be456d tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:07.425262 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-531e3d8c-065e-490f-aa1e-42ae90be456d tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:07.426127 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-531e3d8c-065e-490f-aa1e-42ae90be456d tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:07.426601 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-531e3d8c-065e-490f-aa1e-42ae90be456d tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:07.564801 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-531e3d8c-065e-490f-aa1e-42ae90be456d tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:07.573047 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-531e3d8c-065e-490f-aa1e-42ae90be456d tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1579 microversion: 2.1 time: 0.161606 May 26 16:49:07.573640 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 380/764] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:07 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1579 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:49:07.627529 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-334ad8e3-30fe-47a2-a47f-6c68332b90f1 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:07.628153 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-334ad8e3-30fe-47a2-a47f-6c68332b90f1 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:07.634567 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-334ad8e3-30fe-47a2-a47f-6c68332b90f1 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:07.635017 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-334ad8e3-30fe-47a2-a47f-6c68332b90f1 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:07.635814 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-334ad8e3-30fe-47a2-a47f-6c68332b90f1 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:07.636251 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-334ad8e3-30fe-47a2-a47f-6c68332b90f1 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:07.640810 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:07.778446 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-334ad8e3-30fe-47a2-a47f-6c68332b90f1 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:07.786730 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-334ad8e3-30fe-47a2-a47f-6c68332b90f1 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1558 microversion: 2.1 time: 0.163174 May 26 16:49:07.787332 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 385/765] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:07 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:08.330957 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-305e46b9-d8ad-4aca-be6f-49395a238aa6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:08.331566 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-305e46b9-d8ad-4aca-be6f-49395a238aa6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:08.338042 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-305e46b9-d8ad-4aca-be6f-49395a238aa6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:08.338490 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-305e46b9-d8ad-4aca-be6f-49395a238aa6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:08.339269 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-305e46b9-d8ad-4aca-be6f-49395a238aa6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:08.339707 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-305e46b9-d8ad-4aca-be6f-49395a238aa6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:08.600470 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-30b70765-5756-4c92-9f59-3bf39f035e0e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:08.601581 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-30b70765-5756-4c92-9f59-3bf39f035e0e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:08.609399 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-30b70765-5756-4c92-9f59-3bf39f035e0e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:08.609962 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-30b70765-5756-4c92-9f59-3bf39f035e0e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:08.610798 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-30b70765-5756-4c92-9f59-3bf39f035e0e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:08.611248 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-30b70765-5756-4c92-9f59-3bf39f035e0e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:09.107576 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-305e46b9-d8ad-4aca-be6f-49395a238aa6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:09.116260 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-305e46b9-d8ad-4aca-be6f-49395a238aa6 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1524 microversion: 2.1 time: 0.789565 May 26 16:49:09.117137 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 381/766] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:08 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1524 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:09.122358 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-699f9e86-3b69-4609-a07e-8a5dd4646ea5 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:09.122976 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-699f9e86-3b69-4609-a07e-8a5dd4646ea5 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:09.123133 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-30b70765-5756-4c92-9f59-3bf39f035e0e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:09.129339 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-699f9e86-3b69-4609-a07e-8a5dd4646ea5 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:09.129796 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-699f9e86-3b69-4609-a07e-8a5dd4646ea5 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:09.130582 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-699f9e86-3b69-4609-a07e-8a5dd4646ea5 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:09.130877 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-30b70765-5756-4c92-9f59-3bf39f035e0e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1579 microversion: 2.1 time: 0.535000 May 26 16:49:09.131027 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-699f9e86-3b69-4609-a07e-8a5dd4646ea5 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:09.131475 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 386/767] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:08 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1579 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:49:09.301794 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-699f9e86-3b69-4609-a07e-8a5dd4646ea5 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:09.311194 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-699f9e86-3b69-4609-a07e-8a5dd4646ea5 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1558 microversion: 2.1 time: 0.192970 May 26 16:49:09.320449 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 382/768] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:09 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1558 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:09.768100 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-a5908a9c-5b15-4d6f-a1b4-a4bbb19d23b5 req-19d5a611-b1d8-46aa-9596-d833042fc544 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a691d98-aaca-4c24-9200-19517540e68e", "name": "network-vif-deleted", "tag": "410fa846-df15-41e9-907f-35655843eded"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:49:09.777029 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-a5908a9c-5b15-4d6f-a1b4-a4bbb19d23b5 req-19d5a611-b1d8-46aa-9596-d833042fc544 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:09.777475 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-a5908a9c-5b15-4d6f-a1b4-a4bbb19d23b5 req-19d5a611-b1d8-46aa-9596-d833042fc544 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:09.790378 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-a5908a9c-5b15-4d6f-a1b4-a4bbb19d23b5 req-19d5a611-b1d8-46aa-9596-d833042fc544 service nova] Creating event network-vif-deleted:410fa846-df15-41e9-907f-35655843eded for instance 6a691d98-aaca-4c24-9200-19517540e68e on hv-cinder-83607 May 26 16:49:09.795282 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-a5908a9c-5b15-4d6f-a1b4-a4bbb19d23b5 req-19d5a611-b1d8-46aa-9596-d833042fc544 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031006 May 26 16:49:09.795876 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 387/769] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:49:10.135259 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-9e7d6e12-39cf-4a84-9709-6bb3b7be979f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:10.135866 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-9e7d6e12-39cf-4a84-9709-6bb3b7be979f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:10.143155 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9e7d6e12-39cf-4a84-9709-6bb3b7be979f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:10.143607 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9e7d6e12-39cf-4a84-9709-6bb3b7be979f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:10.144417 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9e7d6e12-39cf-4a84-9709-6bb3b7be979f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:10.144860 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9e7d6e12-39cf-4a84-9709-6bb3b7be979f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:10.147913 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-680d2153-1657-4107-9bb6-11e749b5c754 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:10.149164 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-680d2153-1657-4107-9bb6-11e749b5c754 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:10.157723 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-680d2153-1657-4107-9bb6-11e749b5c754 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:10.158188 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-680d2153-1657-4107-9bb6-11e749b5c754 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:10.158972 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-680d2153-1657-4107-9bb6-11e749b5c754 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:10.159569 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-680d2153-1657-4107-9bb6-11e749b5c754 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:10.220973 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-9e7d6e12-39cf-4a84-9709-6bb3b7be979f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:10.229422 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-9e7d6e12-39cf-4a84-9709-6bb3b7be979f tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1482 microversion: 2.1 time: 0.097950 May 26 16:49:10.230193 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 383/770] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:10 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1482 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:49:10.331740 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-0f2b6075-3119-4278-b55e-d945d2b60021 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:10.332411 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-0f2b6075-3119-4278-b55e-d945d2b60021 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:10.334605 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-680d2153-1657-4107-9bb6-11e749b5c754 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:10.338742 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0f2b6075-3119-4278-b55e-d945d2b60021 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:10.339224 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0f2b6075-3119-4278-b55e-d945d2b60021 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:10.340003 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0f2b6075-3119-4278-b55e-d945d2b60021 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:10.340480 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0f2b6075-3119-4278-b55e-d945d2b60021 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:10.343794 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-680d2153-1657-4107-9bb6-11e749b5c754 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1579 microversion: 2.1 time: 0.200189 May 26 16:49:10.345223 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 388/771] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:10 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1579 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:49:10.561633 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-0f2b6075-3119-4278-b55e-d945d2b60021 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:10.580421 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-0f2b6075-3119-4278-b55e-d945d2b60021 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1558 microversion: 2.1 time: 0.252624 May 26 16:49:10.583045 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 384/772] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:10 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1558 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:49:11.109580 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-0854440a-3c00-4d08-9c63-b16837537e27 req-dd9ccf97-16bf-4324-b644-cb36840ed2a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b7b9106-8559-47d1-93c5-3549d90ee4f8", "name": "network-vif-deleted", "tag": "cca18761-4fc8-4413-bdd9-ee704f060a72"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:49:11.119432 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-0854440a-3c00-4d08-9c63-b16837537e27 req-dd9ccf97-16bf-4324-b644-cb36840ed2a5 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:11.119924 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-0854440a-3c00-4d08-9c63-b16837537e27 req-dd9ccf97-16bf-4324-b644-cb36840ed2a5 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:11.132762 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-0854440a-3c00-4d08-9c63-b16837537e27 req-dd9ccf97-16bf-4324-b644-cb36840ed2a5 service nova] Creating event network-vif-deleted:cca18761-4fc8-4413-bdd9-ee704f060a72 for instance 7b7b9106-8559-47d1-93c5-3549d90ee4f8 on hv-cinder-83607 May 26 16:49:11.138262 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-0854440a-3c00-4d08-9c63-b16837537e27 req-dd9ccf97-16bf-4324-b644-cb36840ed2a5 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032350 May 26 16:49:11.138874 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 389/773] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:49:11.249474 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-e5d23992-9498-447e-9ddc-cc767662aaaf tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:11.250296 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-e5d23992-9498-447e-9ddc-cc767662aaaf tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:11.263851 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e5d23992-9498-447e-9ddc-cc767662aaaf tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:11.264643 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e5d23992-9498-447e-9ddc-cc767662aaaf tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:11.265769 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e5d23992-9498-447e-9ddc-cc767662aaaf tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:11.266864 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e5d23992-9498-447e-9ddc-cc767662aaaf tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:11.330869 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e5d23992-9498-447e-9ddc-cc767662aaaf tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:11.331739 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e5d23992-9498-447e-9ddc-cc767662aaaf tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:11.332645 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.objects.instance [None req-e5d23992-9498-447e-9ddc-cc767662aaaf tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lazy-loading 'fault' on Instance uuid 6a691d98-aaca-4c24-9200-19517540e68e {{(pid=124267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:49:11.362181 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7c57f7ab-904c-4cf4-8ddc-eca5d4cb7360 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:11.362897 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-7c57f7ab-904c-4cf4-8ddc-eca5d4cb7360 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:11.369571 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7c57f7ab-904c-4cf4-8ddc-eca5d4cb7360 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:11.370021 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7c57f7ab-904c-4cf4-8ddc-eca5d4cb7360 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:11.370820 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7c57f7ab-904c-4cf4-8ddc-eca5d4cb7360 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:11.371269 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7c57f7ab-904c-4cf4-8ddc-eca5d4cb7360 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:11.377861 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-e5d23992-9498-447e-9ddc-cc767662aaaf tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9330e65e73394f18b87c5b1d5d47f564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85ded3a20964dbbbc354199f5129d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:11.387096 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-e5d23992-9498-447e-9ddc-cc767662aaaf tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 200 len: 1315 microversion: 2.1 time: 0.143268 May 26 16:49:11.397731 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 385/774] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:11 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:11.547193 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7c57f7ab-904c-4cf4-8ddc-eca5d4cb7360 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:11.558534 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7c57f7ab-904c-4cf4-8ddc-eca5d4cb7360 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1579 microversion: 2.1 time: 0.200404 May 26 16:49:11.559138 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 390/775] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:11 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1579 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:49:11.601680 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-29cb4e2e-1abf-412e-b3f0-79c891dc4c13 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:11.602641 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-29cb4e2e-1abf-412e-b3f0-79c891dc4c13 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:11.618115 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-29cb4e2e-1abf-412e-b3f0-79c891dc4c13 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:11.619004 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-29cb4e2e-1abf-412e-b3f0-79c891dc4c13 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:11.620066 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-29cb4e2e-1abf-412e-b3f0-79c891dc4c13 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:11.620771 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-29cb4e2e-1abf-412e-b3f0-79c891dc4c13 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:11.668046 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-29cb4e2e-1abf-412e-b3f0-79c891dc4c13 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:11.668435 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-29cb4e2e-1abf-412e-b3f0-79c891dc4c13 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:11.668896 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.objects.instance [None req-29cb4e2e-1abf-412e-b3f0-79c891dc4c13 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lazy-loading 'fault' on Instance uuid 7b7b9106-8559-47d1-93c5-3549d90ee4f8 {{(pid=124267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:49:11.711034 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-29cb4e2e-1abf-412e-b3f0-79c891dc4c13 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb976c109cca488aa7317c71b54e5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa63b33258040739dd6367d959c2250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:11.718873 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-29cb4e2e-1abf-412e-b3f0-79c891dc4c13 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 200 len: 1353 microversion: 2.1 time: 0.122088 May 26 16:49:11.719467 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 386/776] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:11 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 1353 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:12.405050 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-de19c012-24be-4e7d-aeab-25573c479dc9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:12.405662 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-de19c012-24be-4e7d-aeab-25573c479dc9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] [instance: 6a691d98-aaca-4c24-9200-19517540e68e] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:12.413324 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-de19c012-24be-4e7d-aeab-25573c479dc9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:12.413765 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-de19c012-24be-4e7d-aeab-25573c479dc9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:12.414556 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-de19c012-24be-4e7d-aeab-25573c479dc9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:12.414996 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-de19c012-24be-4e7d-aeab-25573c479dc9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:12.435720 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-de19c012-24be-4e7d-aeab-25573c479dc9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] HTTP exception thrown: Instance 6a691d98-aaca-4c24-9200-19517540e68e could not be found. May 26 16:49:12.438159 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-de19c012-24be-4e7d-aeab-25573c479dc9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Request method failure captured: May 26 16:49:12.438159 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e HTTP/1.1 May 26 16:49:12.438159 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept: application/json May 26 16:49:12.438159 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity May 26 16:49:12.438159 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Connection: close May 26 16:49:12.438159 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Length: 0 May 26 16:49:12.438159 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Type: application/json May 26 16:49:12.438159 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Host: 10.222.0.102 May 26 16:49:12.438159 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None May 26 16:49:12.438159 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 May 26 16:49:12.438159 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABij62o9giAUjK9QPbUFbwFo-FgFlOy7dIdimEDaohYi-sKTCdB1x5HtixELEAzUkpBuerDG9JUdHvExIjWA4U-cGIqZbLgDVo_-1KrAr5aGX22qLivGdFGb8QTOdP7EHcYJDUTZmj-LaOBh6ZTeQxUKquK1A4-AFQYG9aL6_6JaqjZXrQ May 26 16:49:12.438159 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Id: None May 26 16:49:12.438159 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Name: None May 26 16:49:12.438159 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed May 26 16:49:12.438159 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True May 26 16:49:12.438159 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default May 26 16:49:12.438159 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default May 26 16:49:12.438159 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Id: a85ded3a20964dbbbc354199f5129d9b May 26 16:49:12.438159 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1592668870 May 26 16:49:12.438159 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Role: reader,member May 26 16:49:12.438159 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Roles: reader,member May 26 16:49:12.439724 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/a85ded3a20964dbbbc354199f5129d9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/a85ded3a20964dbbbc354199f5129d9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/a85ded3a20964dbbbc354199f5129d9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_a85ded3a20964dbbbc354199f5129d9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:49:12.439724 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1592668870 May 26 16:49:12.439724 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Id: a85ded3a20964dbbbc354199f5129d9b May 26 16:49:12.439724 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1592668870 May 26 16:49:12.439724 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User: tempest-ServerRescueNegativeTestJSON-1592668870-project May 26 16:49:12.439724 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default May 26 16:49:12.439724 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default May 26 16:49:12.439724 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Id: 9330e65e73394f18b87c5b1d5d47f564 May 26 16:49:12.439724 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1592668870-project May 26 16:49:12.439724 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: method: > May 26 16:49:12.439724 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: exception: Instance 6a691d98-aaca-4c24-9200-19517540e68e could not be found. May 26 16:49:12.439724 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: action_args: {'id': '6a691d98-aaca-4c24-9200-19517540e68e'} May 26 16:49:12.440692 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:49:12.440692 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:49:12.440692 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:49:12.440692 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:49:12.440692 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:49:12.440692 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:49:12.440692 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:49:12.440692 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:49:12.440692 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:49:12.440692 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:49:12.440692 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a691d98-aaca-4c24-9200-19517540e68e could not be found. May 26 16:49:12.440692 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:49:12.440692 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:49:12.440692 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:49:12.440692 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:49:12.440692 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:49:12.440692 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:49:12.440692 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:49:12.440692 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:49:12.440692 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:49:12.442094 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:49:12.442094 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 16:49:12.442094 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 16:49:12.442094 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:49:12.442094 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:49:12.442094 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:49:12.442094 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:49:12.442094 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a691d98-aaca-4c24-9200-19517540e68e could not be found. May 26 16:49:12.442094 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:49:12.442094 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:49:12.442094 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:49:12.442094 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:49:12.442094 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:49:12.442094 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:49:12.442094 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:49:12.442094 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:49:12.442094 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a691d98-aaca-4c24-9200-19517540e68e could not be found. May 26 16:49:12.442094 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:49:12.443703 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-de19c012-24be-4e7d-aeab-25573c479dc9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] Returning 404 to user: Instance 6a691d98-aaca-4c24-9200-19517540e68e could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:49:12.443703 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-de19c012-24be-4e7d-aeab-25573c479dc9 tempest-ServerRescueNegativeTestJSON-1592668870 tempest-ServerRescueNegativeTestJSON-1592668870-project] 10.222.0.102 "GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e" status: 404 len: 111 microversion: 2.1 time: 0.038534 May 26 16:49:12.443703 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 391/777] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:12 2022] GET /compute/v2.1/servers/6a691d98-aaca-4c24-9200-19517540e68e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 16:49:12.577268 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-1a5f15a3-3186-4dfb-9eb7-43932d41ee28 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:12.577811 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-1a5f15a3-3186-4dfb-9eb7-43932d41ee28 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:12.584962 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1a5f15a3-3186-4dfb-9eb7-43932d41ee28 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:12.585419 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1a5f15a3-3186-4dfb-9eb7-43932d41ee28 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:12.586207 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1a5f15a3-3186-4dfb-9eb7-43932d41ee28 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:12.586644 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1a5f15a3-3186-4dfb-9eb7-43932d41ee28 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:12.735379 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-262cc7d9-855b-44ae-adad-75409038fd04 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:12.736493 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-262cc7d9-855b-44ae-adad-75409038fd04 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] [instance: 7b7b9106-8559-47d1-93c5-3549d90ee4f8] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:12.743747 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-262cc7d9-855b-44ae-adad-75409038fd04 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:12.744352 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-262cc7d9-855b-44ae-adad-75409038fd04 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:12.745312 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-262cc7d9-855b-44ae-adad-75409038fd04 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:12.745835 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-262cc7d9-855b-44ae-adad-75409038fd04 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:12.760973 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-262cc7d9-855b-44ae-adad-75409038fd04 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] HTTP exception thrown: Instance 7b7b9106-8559-47d1-93c5-3549d90ee4f8 could not be found. May 26 16:49:12.762546 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-262cc7d9-855b-44ae-adad-75409038fd04 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Request method failure captured: May 26 16:49:12.762546 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 HTTP/1.1 May 26 16:49:12.762546 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept: application/json May 26 16:49:12.762546 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity May 26 16:49:12.762546 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Connection: close May 26 16:49:12.762546 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Length: 0 May 26 16:49:12.762546 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Type: application/json May 26 16:49:12.762546 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Host: 10.222.0.102 May 26 16:49:12.762546 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None May 26 16:49:12.762546 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 May 26 16:49:12.762546 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABij65rILUTYt3AicdOZiE9Hcto5PmVJiqf-huCpwTlocMtGnlBjVmxio0dWQ_O85ubmsLmx4x_9qE_1HzRBaEm8roiNgmqjMOOg2153zgr1c62vdxA3pxTj4uLywuJMQ43xx07ntinv_i1MfymedwZnljMdYuQ2YFZpI67C_Yabg96P78 May 26 16:49:12.762546 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Id: None May 26 16:49:12.762546 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Name: None May 26 16:49:12.762546 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed May 26 16:49:12.762546 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True May 26 16:49:12.762546 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default May 26 16:49:12.762546 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default May 26 16:49:12.762546 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Id: 7fa63b33258040739dd6367d959c2250 May 26 16:49:12.762546 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-TestMinimumBasicScenario-200688835 May 26 16:49:12.762546 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Role: reader,member May 26 16:49:12.762546 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Roles: reader,member May 26 16:49:12.764045 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/7fa63b33258040739dd6367d959c2250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/7fa63b33258040739dd6367d959c2250"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/7fa63b33258040739dd6367d959c2250"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_7fa63b33258040739dd6367d959c2250"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:49:12.764045 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-TestMinimumBasicScenario-200688835 May 26 16:49:12.764045 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Id: 7fa63b33258040739dd6367d959c2250 May 26 16:49:12.764045 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-TestMinimumBasicScenario-200688835 May 26 16:49:12.764045 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User: tempest-TestMinimumBasicScenario-200688835-project May 26 16:49:12.764045 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default May 26 16:49:12.764045 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default May 26 16:49:12.764045 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Id: bb976c109cca488aa7317c71b54e5002 May 26 16:49:12.764045 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-TestMinimumBasicScenario-200688835-project May 26 16:49:12.764045 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: method: > May 26 16:49:12.764045 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: exception: Instance 7b7b9106-8559-47d1-93c5-3549d90ee4f8 could not be found. May 26 16:49:12.764045 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: action_args: {'id': '7b7b9106-8559-47d1-93c5-3549d90ee4f8'} May 26 16:49:12.764933 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:49:12.764933 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:49:12.764933 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:49:12.764933 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:49:12.764933 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:49:12.764933 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:49:12.764933 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:49:12.764933 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:49:12.764933 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:49:12.764933 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:49:12.764933 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b7b9106-8559-47d1-93c5-3549d90ee4f8 could not be found. May 26 16:49:12.764933 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:49:12.764933 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:49:12.764933 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:49:12.764933 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:49:12.764933 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:49:12.764933 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:49:12.764933 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:49:12.764933 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:49:12.764933 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:49:12.766571 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:49:12.766571 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 16:49:12.766571 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 16:49:12.766571 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:49:12.766571 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:49:12.766571 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:49:12.766571 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:49:12.766571 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b7b9106-8559-47d1-93c5-3549d90ee4f8 could not be found. May 26 16:49:12.766571 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:49:12.766571 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:49:12.766571 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:49:12.766571 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:49:12.766571 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:49:12.766571 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:49:12.766571 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:49:12.766571 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:49:12.766571 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b7b9106-8559-47d1-93c5-3549d90ee4f8 could not be found. May 26 16:49:12.766571 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:49:12.767699 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-262cc7d9-855b-44ae-adad-75409038fd04 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Returning 404 to user: Instance 7b7b9106-8559-47d1-93c5-3549d90ee4f8 could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:49:12.767699 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-262cc7d9-855b-44ae-adad-75409038fd04 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8" status: 404 len: 111 microversion: 2.1 time: 0.032650 May 26 16:49:12.767699 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 392/778] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:12 2022] GET /compute/v2.1/servers/7b7b9106-8559-47d1-93c5-3549d90ee4f8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 16:49:12.777650 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-b9152eff-4eeb-439f-8ea2-f6bfb13b6a50 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] Calling method '.version_select at 0x7f93a3ba7d30>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:12.807150 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-b9152eff-4eeb-439f-8ea2-f6bfb13b6a50 tempest-TestMinimumBasicScenario-200688835 tempest-TestMinimumBasicScenario-200688835-project] 10.222.0.102 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1617699610" status: 202 len: 0 microversion: 2.1 time: 0.036597 May 26 16:49:12.807757 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 393/779] 10.222.0.102 () {58 vars in 1276 bytes} [Thu May 26 16:49:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1617699610 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 16:49:12.839395 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-1a5f15a3-3186-4dfb-9eb7-43932d41ee28 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:12.853860 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-1a5f15a3-3186-4dfb-9eb7-43932d41ee28 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1579 microversion: 2.1 time: 0.280317 May 26 16:49:12.854922 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 387/780] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:12 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1579 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:13.877721 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2229b47e-909a-40e9-9a6b-75a0de87fe32 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:13.878516 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2229b47e-909a-40e9-9a6b-75a0de87fe32 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:13.891040 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2229b47e-909a-40e9-9a6b-75a0de87fe32 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:13.892288 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2229b47e-909a-40e9-9a6b-75a0de87fe32 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:13.893175 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2229b47e-909a-40e9-9a6b-75a0de87fe32 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:13.893629 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2229b47e-909a-40e9-9a6b-75a0de87fe32 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:14.119904 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-2229b47e-909a-40e9-9a6b-75a0de87fe32 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:14.128871 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2229b47e-909a-40e9-9a6b-75a0de87fe32 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1579 microversion: 2.1 time: 0.258363 May 26 16:49:14.129558 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 394/781] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:13 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1579 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:15.153216 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-89416a6b-b0eb-445e-a71a-25e15431d922 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:15.153876 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-89416a6b-b0eb-445e-a71a-25e15431d922 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:15.167839 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-89416a6b-b0eb-445e-a71a-25e15431d922 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:15.168415 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-89416a6b-b0eb-445e-a71a-25e15431d922 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:15.169629 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-89416a6b-b0eb-445e-a71a-25e15431d922 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:15.170248 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-89416a6b-b0eb-445e-a71a-25e15431d922 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:15.807869 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-89416a6b-b0eb-445e-a71a-25e15431d922 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:15.818272 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-89416a6b-b0eb-445e-a71a-25e15431d922 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1579 microversion: 2.1 time: 0.675412 May 26 16:49:15.830021 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 388/782] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:15 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1579 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:49:16.836975 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6a927f25-d485-47bd-b6eb-5f402d0f94c3 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:16.837603 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-6a927f25-d485-47bd-b6eb-5f402d0f94c3 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:16.839993 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:16.845509 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6a927f25-d485-47bd-b6eb-5f402d0f94c3 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:16.846275 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6a927f25-d485-47bd-b6eb-5f402d0f94c3 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:16.847305 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6a927f25-d485-47bd-b6eb-5f402d0f94c3 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:16.854885 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6a927f25-d485-47bd-b6eb-5f402d0f94c3 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:17.190379 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6a927f25-d485-47bd-b6eb-5f402d0f94c3 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:17.199674 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6a927f25-d485-47bd-b6eb-5f402d0f94c3 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1579 microversion: 2.1 time: 0.367740 May 26 16:49:17.230487 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 395/783] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:16 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1579 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:18.239181 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-e9dc7434-e27c-4f58-82cb-7004cecc5a44 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:18.239181 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-e9dc7434-e27c-4f58-82cb-7004cecc5a44 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:18.239181 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e9dc7434-e27c-4f58-82cb-7004cecc5a44 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:18.239181 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e9dc7434-e27c-4f58-82cb-7004cecc5a44 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:18.240363 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e9dc7434-e27c-4f58-82cb-7004cecc5a44 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:18.241207 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e9dc7434-e27c-4f58-82cb-7004cecc5a44 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:18.498444 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-e9dc7434-e27c-4f58-82cb-7004cecc5a44 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:18.506394 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=100 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:18.516853 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-e9dc7434-e27c-4f58-82cb-7004cecc5a44 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1579 microversion: 2.1 time: 0.290182 May 26 16:49:18.517730 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 389/784] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:18 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1579 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:19.535856 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-088a16fe-2c02-4124-8dfc-b8f6b6d58b28 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:19.536643 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-088a16fe-2c02-4124-8dfc-b8f6b6d58b28 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:19.557549 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-088a16fe-2c02-4124-8dfc-b8f6b6d58b28 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:19.558016 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-088a16fe-2c02-4124-8dfc-b8f6b6d58b28 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:19.558823 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-088a16fe-2c02-4124-8dfc-b8f6b6d58b28 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:19.559268 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-088a16fe-2c02-4124-8dfc-b8f6b6d58b28 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:20.112314 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-088a16fe-2c02-4124-8dfc-b8f6b6d58b28 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:20.124036 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-088a16fe-2c02-4124-8dfc-b8f6b6d58b28 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1579 microversion: 2.1 time: 0.591944 May 26 16:49:20.126882 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 396/785] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:19 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1579 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:21.145608 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-d631e8a4-e61a-4a6b-8035-976f85a48065 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:21.146299 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-d631e8a4-e61a-4a6b-8035-976f85a48065 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:21.149594 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:21.157976 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d631e8a4-e61a-4a6b-8035-976f85a48065 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:21.158622 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d631e8a4-e61a-4a6b-8035-976f85a48065 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:21.159796 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d631e8a4-e61a-4a6b-8035-976f85a48065 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:21.161016 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d631e8a4-e61a-4a6b-8035-976f85a48065 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:21.547842 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-d631e8a4-e61a-4a6b-8035-976f85a48065 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:21.562193 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-d631e8a4-e61a-4a6b-8035-976f85a48065 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1579 microversion: 2.1 time: 0.421793 May 26 16:49:21.563724 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 390/786] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:21 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1579 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:21.564970 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-ead92f13-f3a8-489f-92e8-776ee9d5dd74 req-2621c1fe-a08c-4b4c-989c-987f7dfe87af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "898074a4-2c24-403a-bdd9-e9809f6375fd", "name": "network-vif-plugged", "status": "completed", "tag": "a5a3472f-1b24-4c5b-ada9-48c5e198da12"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:49:21.579052 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-ead92f13-f3a8-489f-92e8-776ee9d5dd74 req-2621c1fe-a08c-4b4c-989c-987f7dfe87af service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:21.579785 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-ead92f13-f3a8-489f-92e8-776ee9d5dd74 req-2621c1fe-a08c-4b4c-989c-987f7dfe87af service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:21.600222 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-ead92f13-f3a8-489f-92e8-776ee9d5dd74 req-2621c1fe-a08c-4b4c-989c-987f7dfe87af service nova] Creating event network-vif-plugged:a5a3472f-1b24-4c5b-ada9-48c5e198da12 for instance 898074a4-2c24-403a-bdd9-e9809f6375fd on hv-cinder-83607 May 26 16:49:21.608064 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-ead92f13-f3a8-489f-92e8-776ee9d5dd74 req-2621c1fe-a08c-4b4c-989c-987f7dfe87af service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051181 May 26 16:49:21.609953 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 397/787] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:49:22.582966 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-26ed2d7e-355d-4fd6-894e-96ae4ff2b421 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:22.585074 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-26ed2d7e-355d-4fd6-894e-96ae4ff2b421 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:22.592301 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-26ed2d7e-355d-4fd6-894e-96ae4ff2b421 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:22.593046 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-26ed2d7e-355d-4fd6-894e-96ae4ff2b421 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:22.594257 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-26ed2d7e-355d-4fd6-894e-96ae4ff2b421 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:22.594780 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-26ed2d7e-355d-4fd6-894e-96ae4ff2b421 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:22.759740 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-26ed2d7e-355d-4fd6-894e-96ae4ff2b421 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:22.767401 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-26ed2d7e-355d-4fd6-894e-96ae4ff2b421 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1579 microversion: 2.1 time: 0.189917 May 26 16:49:22.767977 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 391/788] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:22 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1579 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:23.787966 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-479deed0-02ac-4d54-a553-cb998b0952ac tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:23.788981 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-479deed0-02ac-4d54-a553-cb998b0952ac tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:23.797059 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-479deed0-02ac-4d54-a553-cb998b0952ac tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:23.797903 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-479deed0-02ac-4d54-a553-cb998b0952ac tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:23.798899 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-479deed0-02ac-4d54-a553-cb998b0952ac tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:23.799626 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-479deed0-02ac-4d54-a553-cb998b0952ac tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:24.014673 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-479deed0-02ac-4d54-a553-cb998b0952ac tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:24.028832 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-479deed0-02ac-4d54-a553-cb998b0952ac tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1566 microversion: 2.1 time: 0.246315 May 26 16:49:24.043072 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 398/789] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:23 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1566 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:24.080214 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-0a530431-1de7-48a5-9704-3679b31dccd3 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:24.082009 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-0a530431-1de7-48a5-9704-3679b31dccd3 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:24.091837 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0a530431-1de7-48a5-9704-3679b31dccd3 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:24.092518 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0a530431-1de7-48a5-9704-3679b31dccd3 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:24.093415 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0a530431-1de7-48a5-9704-3679b31dccd3 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:24.093933 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0a530431-1de7-48a5-9704-3679b31dccd3 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:24.135512 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-0a530431-1de7-48a5-9704-3679b31dccd3 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059935 May 26 16:49:24.141018 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 392/790] 10.222.0.102 () {58 vars in 1306 bytes} [Thu May 26 16:49:24 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 16:49:24.247039 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3f5690e1-5e7a-4a79-b9fb-32f9d79aa786 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:24.247799 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-3f5690e1-5e7a-4a79-b9fb-32f9d79aa786 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:24.258469 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3f5690e1-5e7a-4a79-b9fb-32f9d79aa786 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:24.259143 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3f5690e1-5e7a-4a79-b9fb-32f9d79aa786 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:24.260566 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3f5690e1-5e7a-4a79-b9fb-32f9d79aa786 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:24.262497 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3f5690e1-5e7a-4a79-b9fb-32f9d79aa786 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:24.325787 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-3f5690e1-5e7a-4a79-b9fb-32f9d79aa786 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Going to try to terminate instance {{(pid=124266) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 16:49:24.414763 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-3f5690e1-5e7a-4a79-b9fb-32f9d79aa786 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "DELETE /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 204 len: 0 microversion: 2.1 time: 0.174048 May 26 16:49:24.416221 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 399/791] 10.222.0.102 () {58 vars in 1243 bytes} [Thu May 26 16:49:24 2022] DELETE /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 16:49:24.427147 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-b51e0312-8448-494d-8138-cf72a41050bb tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:24.427760 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-b51e0312-8448-494d-8138-cf72a41050bb tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:24.435463 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b51e0312-8448-494d-8138-cf72a41050bb tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:24.435979 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b51e0312-8448-494d-8138-cf72a41050bb tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:24.436795 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b51e0312-8448-494d-8138-cf72a41050bb tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:24.437292 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b51e0312-8448-494d-8138-cf72a41050bb tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:24.591659 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-b51e0312-8448-494d-8138-cf72a41050bb tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:24.600958 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-b51e0312-8448-494d-8138-cf72a41050bb tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1677 microversion: 2.1 time: 0.179138 May 26 16:49:24.601924 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 393/792] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:24 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:49:25.634528 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a2dad543-89b0-419d-89be-a4b62bf091d3 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:25.637970 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a2dad543-89b0-419d-89be-a4b62bf091d3 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:25.653881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a2dad543-89b0-419d-89be-a4b62bf091d3 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:25.660953 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a2dad543-89b0-419d-89be-a4b62bf091d3 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:25.662298 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a2dad543-89b0-419d-89be-a4b62bf091d3 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:25.663501 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a2dad543-89b0-419d-89be-a4b62bf091d3 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:26.115300 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a2dad543-89b0-419d-89be-a4b62bf091d3 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:26.126905 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a2dad543-89b0-419d-89be-a4b62bf091d3 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1677 microversion: 2.1 time: 0.501725 May 26 16:49:26.127563 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 400/793] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:25 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1677 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:27.147173 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-237adc9c-6bf8-4ca3-bdd0-6e7d4b28a891 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:27.147950 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-237adc9c-6bf8-4ca3-bdd0-6e7d4b28a891 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:27.164673 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-237adc9c-6bf8-4ca3-bdd0-6e7d4b28a891 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:27.165484 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-237adc9c-6bf8-4ca3-bdd0-6e7d4b28a891 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:27.166943 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-237adc9c-6bf8-4ca3-bdd0-6e7d4b28a891 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:27.167741 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-237adc9c-6bf8-4ca3-bdd0-6e7d4b28a891 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:27.592505 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-237adc9c-6bf8-4ca3-bdd0-6e7d4b28a891 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:27.616868 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-237adc9c-6bf8-4ca3-bdd0-6e7d4b28a891 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1677 microversion: 2.1 time: 0.473341 May 26 16:49:27.620450 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 394/794] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:27 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1677 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:28.465477 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-e9dffdc6-559b-409d-9b9c-d37cfdc10896 req-e05d4778-4c7a-4a87-88c2-92ef6e82e7d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15756f2d-4f17-4b50-b02e-4cf50051ec29", "name": "network-vif-deleted", "tag": "64f50be8-9caf-42c2-88ea-4042b60bcf83"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:49:28.490972 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-e9dffdc6-559b-409d-9b9c-d37cfdc10896 req-e05d4778-4c7a-4a87-88c2-92ef6e82e7d6 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:28.491441 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-e9dffdc6-559b-409d-9b9c-d37cfdc10896 req-e05d4778-4c7a-4a87-88c2-92ef6e82e7d6 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:28.525209 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-e9dffdc6-559b-409d-9b9c-d37cfdc10896 req-e05d4778-4c7a-4a87-88c2-92ef6e82e7d6 service nova] Creating event network-vif-deleted:64f50be8-9caf-42c2-88ea-4042b60bcf83 for instance 15756f2d-4f17-4b50-b02e-4cf50051ec29 on hv-cinder-83607 May 26 16:49:28.542009 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-e9dffdc6-559b-409d-9b9c-d37cfdc10896 req-e05d4778-4c7a-4a87-88c2-92ef6e82e7d6 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078142 May 26 16:49:28.544817 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 401/795] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:49:28.640963 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-c1f9fa7d-55b1-4266-a81f-28d14d28c561 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:28.642972 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-c1f9fa7d-55b1-4266-a81f-28d14d28c561 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:28.671890 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c1f9fa7d-55b1-4266-a81f-28d14d28c561 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:28.672612 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c1f9fa7d-55b1-4266-a81f-28d14d28c561 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:28.674077 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c1f9fa7d-55b1-4266-a81f-28d14d28c561 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:28.674715 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c1f9fa7d-55b1-4266-a81f-28d14d28c561 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:28.849602 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-c1f9fa7d-55b1-4266-a81f-28d14d28c561 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:28.861421 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-c1f9fa7d-55b1-4266-a81f-28d14d28c561 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 200 len: 1326 microversion: 2.1 time: 0.225923 May 26 16:49:28.865801 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 395/796] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:28 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 1326 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:29.897783 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7d59a2a1-96ed-43fd-85c5-3c0657d833d3 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:29.899022 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-7d59a2a1-96ed-43fd-85c5-3c0657d833d3 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:29.913214 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7d59a2a1-96ed-43fd-85c5-3c0657d833d3 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:29.914355 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7d59a2a1-96ed-43fd-85c5-3c0657d833d3 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:29.916014 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7d59a2a1-96ed-43fd-85c5-3c0657d833d3 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:29.917061 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7d59a2a1-96ed-43fd-85c5-3c0657d833d3 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:29.969047 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-7d59a2a1-96ed-43fd-85c5-3c0657d833d3 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] HTTP exception thrown: Instance 15756f2d-4f17-4b50-b02e-4cf50051ec29 could not be found. May 26 16:49:29.972951 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7d59a2a1-96ed-43fd-85c5-3c0657d833d3 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Request method failure captured: May 26 16:49:29.972951 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 HTTP/1.1 May 26 16:49:29.972951 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept: application/json May 26 16:49:29.972951 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity May 26 16:49:29.972951 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Connection: close May 26 16:49:29.972951 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Length: 0 May 26 16:49:29.972951 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Type: application/json May 26 16:49:29.972951 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Host: 10.222.0.102 May 26 16:49:29.972951 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None May 26 16:49:29.972951 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 May 26 16:49:29.972951 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABij62tIyfHG9bbMAhr2tBeKPWBiSvUJcs9s6YREEv_6wnAH-mNVdMht8iR1u6blpLBUalvLqTB_SVg9IBiW1W2cjBoehkJn5CAHy0qZ3pNhIj0byh_snroNLM2T21thJ9-tl58Apqya7QASSbtajZPlxLnPFzuiZcaIHf56TIl8heh3pA May 26 16:49:29.972951 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Id: None May 26 16:49:29.972951 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Name: None May 26 16:49:29.972951 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed May 26 16:49:29.972951 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True May 26 16:49:29.972951 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default May 26 16:49:29.972951 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default May 26 16:49:29.972951 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Id: 769867aa4086443a809d8fd8d3b605e2 May 26 16:49:29.972951 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-AttachVolumeTestJSON-168495231 May 26 16:49:29.972951 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Role: reader,member May 26 16:49:29.972951 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Roles: reader,member May 26 16:49:29.975849 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/769867aa4086443a809d8fd8d3b605e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/769867aa4086443a809d8fd8d3b605e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/769867aa4086443a809d8fd8d3b605e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_769867aa4086443a809d8fd8d3b605e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:49:29.975849 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-AttachVolumeTestJSON-168495231 May 26 16:49:29.975849 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Id: 769867aa4086443a809d8fd8d3b605e2 May 26 16:49:29.975849 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-AttachVolumeTestJSON-168495231 May 26 16:49:29.975849 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User: tempest-AttachVolumeTestJSON-168495231-project May 26 16:49:29.975849 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default May 26 16:49:29.975849 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default May 26 16:49:29.975849 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Id: 2e5e1735e7f54f2d8943a0f55311394b May 26 16:49:29.975849 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-AttachVolumeTestJSON-168495231-project May 26 16:49:29.975849 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: method: > May 26 16:49:29.975849 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: exception: Instance 15756f2d-4f17-4b50-b02e-4cf50051ec29 could not be found. May 26 16:49:29.975849 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: action_args: {'id': '15756f2d-4f17-4b50-b02e-4cf50051ec29'} May 26 16:49:29.978454 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:49:29.978454 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:49:29.978454 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:49:29.978454 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:49:29.978454 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:49:29.978454 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:49:29.978454 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:49:29.978454 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:49:29.978454 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:49:29.978454 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:49:29.978454 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15756f2d-4f17-4b50-b02e-4cf50051ec29 could not be found. May 26 16:49:29.978454 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:49:29.978454 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:49:29.978454 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:49:29.978454 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:49:29.978454 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:49:29.978454 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:49:29.978454 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:49:29.978454 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:49:29.978454 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:49:29.984740 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:49:29.984740 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 16:49:29.984740 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 16:49:29.984740 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:49:29.984740 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:49:29.984740 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:49:29.984740 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:49:29.984740 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15756f2d-4f17-4b50-b02e-4cf50051ec29 could not be found. May 26 16:49:29.984740 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:49:29.984740 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:49:29.984740 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:49:29.984740 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:49:29.984740 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:49:29.984740 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:49:29.984740 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:49:29.984740 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:49:29.984740 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15756f2d-4f17-4b50-b02e-4cf50051ec29 could not be found. May 26 16:49:29.984740 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:49:29.988829 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7d59a2a1-96ed-43fd-85c5-3c0657d833d3 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Returning 404 to user: Instance 15756f2d-4f17-4b50-b02e-4cf50051ec29 could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:49:29.988829 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7d59a2a1-96ed-43fd-85c5-3c0657d833d3 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 404 len: 111 microversion: 2.1 time: 0.103237 May 26 16:49:29.988829 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 402/797] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:29 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 16:49:30.001877 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-3e7c53d7-dd59-4cab-8ad4-0036dec66d91 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '.version_select at 0x7f93a3c825e0>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:30.040254 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-3e7c53d7-dd59-4cab-8ad4-0036dec66d91 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1131044428" status: 202 len: 0 microversion: 2.1 time: 0.046466 May 26 16:49:30.045552 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 396/798] 10.222.0.102 () {58 vars in 1225 bytes} [Thu May 26 16:49:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1131044428 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 16:49:31.491829 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-84c0cad0-ed4a-4261-8261-49706eb31959 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Action: 'create', calling method: .version_select at 0x7f93a3df2160>, body: {"keypair": {"name": "tempest-keypair-305353559", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYIp3GVkrzOwVZOluZMcj35JcmCj4p2Y7B7Ad5P/mpwILYIih0txVUjZ9GY/wmXmfYQ3SmJ32TyuYv/Ufe3A3VeVB5dBPVS9p0/iBNwBGrp+KE5/CsJjH/gnOcoY2K+7g=="}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:49:31.515008 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-84c0cad0-ed4a-4261-8261-49706eb31959 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Getting quotas for project 769867aa4086443a809d8fd8d3b605e2. Resources: {'key_pairs'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:49:31.521494 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-84c0cad0-ed4a-4261-8261-49706eb31959 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Getting quotas for user 2e5e1735e7f54f2d8943a0f55311394b and project 769867aa4086443a809d8fd8d3b605e2. Resources: {'key_pairs'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:49:31.587108 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-84c0cad0-ed4a-4261-8261-49706eb31959 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.099335 May 26 16:49:31.587847 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 403/799] 10.222.0.102 () {60 vars in 1163 bytes} [Thu May 26 16:49:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:49:33.998506 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-be3690bf-00f8-42d2-8cb0-ace2237f7b8a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-131118199", "imageRef": "d74c4a51-21fe-41d5-865a-cb93604ac3aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "df66d935-a4b3-44d2-8e7d-0763779d3216"}], "security_groups": [{"name": "tempest-securitygroup--1601273808"}], "key_name": "tempest-keypair-305353559", "user_data": "}} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:49:34.267432 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.network.neutron [None req-be3690bf-00f8-42d2-8cb0-ace2237f7b8a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] validate_networks() for [('df66d935-a4b3-44d2-8e7d-0763779d3216', None, None, None, None, None)] {{(pid=124267) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:49:35.477891 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-be3690bf-00f8-42d2-8cb0-ace2237f7b8a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Flavor limits 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:49:35.479915 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-be3690bf-00f8-42d2-8cb0-ace2237f7b8a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Image limits 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:49:35.481510 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-be3690bf-00f8-42d2-8cb0-ace2237f7b8a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Flavor pref 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:49:35.493790 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-be3690bf-00f8-42d2-8cb0-ace2237f7b8a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Image pref 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:49:35.502079 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-be3690bf-00f8-42d2-8cb0-ace2237f7b8a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:49:35.568409 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-be3690bf-00f8-42d2-8cb0-ace2237f7b8a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:35.569215 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-be3690bf-00f8-42d2-8cb0-ace2237f7b8a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:35.570715 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-be3690bf-00f8-42d2-8cb0-ace2237f7b8a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:35.571456 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-be3690bf-00f8-42d2-8cb0-ace2237f7b8a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:35.637863 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.quota [None req-be3690bf-00f8-42d2-8cb0-ace2237f7b8a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Getting quotas for project 769867aa4086443a809d8fd8d3b605e2. Resources: {'cores', 'instances', 'ram'} {{(pid=124267) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:49:35.648661 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.quota [None req-be3690bf-00f8-42d2-8cb0-ace2237f7b8a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Getting quotas for user 2e5e1735e7f54f2d8943a0f55311394b and project 769867aa4086443a809d8fd8d3b605e2. Resources: {'cores', 'instances', 'ram'} {{(pid=124267) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:49:35.688808 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-be3690bf-00f8-42d2-8cb0-ace2237f7b8a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Going to run 1 instances... {{(pid=124267) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:49:35.691458 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-be3690bf-00f8-42d2-8cb0-ace2237f7b8a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 1d458ca8-f76c-432f-84ff-ab64b839c49d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d74c4a51-21fe-41d5-865a-cb93604ac3aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:49:35.792324 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-be3690bf-00f8-42d2-8cb0-ace2237f7b8a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.798867 May 26 16:49:35.793544 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 397/800] 10.222.0.102 () {60 vars in 1151 bytes} [Thu May 26 16:49:33 2022] POST /compute/v2.1/servers => generated 404 bytes in 1800 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 16:49:35.809806 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e130492c-6603-4d12-b72b-3ff460b23491 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:35.810667 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e130492c-6603-4d12-b72b-3ff460b23491 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 1d458ca8-f76c-432f-84ff-ab64b839c49d] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:35.971066 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e130492c-6603-4d12-b72b-3ff460b23491 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:35.981822 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e130492c-6603-4d12-b72b-3ff460b23491 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d" status: 200 len: 1240 microversion: 2.1 time: 0.181368 May 26 16:49:35.982605 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 404/801] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:35 2022] GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d => generated 1240 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:49:37.033744 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-94ef4bc5-db04-4d23-9f83-45a11a06cc5f tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:37.034983 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-94ef4bc5-db04-4d23-9f83-45a11a06cc5f tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 1d458ca8-f76c-432f-84ff-ab64b839c49d] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:37.057760 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-94ef4bc5-db04-4d23-9f83-45a11a06cc5f tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:37.058622 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-94ef4bc5-db04-4d23-9f83-45a11a06cc5f tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:37.060277 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-94ef4bc5-db04-4d23-9f83-45a11a06cc5f tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:37.061523 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-94ef4bc5-db04-4d23-9f83-45a11a06cc5f tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:37.240080 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-94ef4bc5-db04-4d23-9f83-45a11a06cc5f tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:37.249079 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-94ef4bc5-db04-4d23-9f83-45a11a06cc5f tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d" status: 200 len: 1292 microversion: 2.1 time: 0.226426 May 26 16:49:37.250930 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 398/802] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:37 2022] GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d => generated 1292 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:38.277453 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f99e77f1-bc7d-40e0-9515-5ef2f269f065 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:38.281685 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f99e77f1-bc7d-40e0-9515-5ef2f269f065 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 1d458ca8-f76c-432f-84ff-ab64b839c49d] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:38.290708 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f99e77f1-bc7d-40e0-9515-5ef2f269f065 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:38.294336 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f99e77f1-bc7d-40e0-9515-5ef2f269f065 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:38.295852 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f99e77f1-bc7d-40e0-9515-5ef2f269f065 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:38.299263 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f99e77f1-bc7d-40e0-9515-5ef2f269f065 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:38.303317 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:38.487125 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f99e77f1-bc7d-40e0-9515-5ef2f269f065 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:38.507227 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f99e77f1-bc7d-40e0-9515-5ef2f269f065 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d" status: 200 len: 1298 microversion: 2.1 time: 0.236671 May 26 16:49:38.509063 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 405/803] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:38 2022] GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d => generated 1298 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:39.526875 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-fd56d37d-5a69-4dc1-a87d-94b49b524da9 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:39.527568 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-fd56d37d-5a69-4dc1-a87d-94b49b524da9 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 1d458ca8-f76c-432f-84ff-ab64b839c49d] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:39.543705 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fd56d37d-5a69-4dc1-a87d-94b49b524da9 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:39.545323 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fd56d37d-5a69-4dc1-a87d-94b49b524da9 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:39.550716 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fd56d37d-5a69-4dc1-a87d-94b49b524da9 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:39.551437 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fd56d37d-5a69-4dc1-a87d-94b49b524da9 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:39.778223 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-fd56d37d-5a69-4dc1-a87d-94b49b524da9 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:39.793388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-fd56d37d-5a69-4dc1-a87d-94b49b524da9 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d" status: 200 len: 1298 microversion: 2.1 time: 0.270431 May 26 16:49:39.793974 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 399/804] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:39 2022] GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d => generated 1298 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:40.829117 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-52761605-065e-4441-a9a3-60fccaab6e15 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:40.831407 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-52761605-065e-4441-a9a3-60fccaab6e15 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 1d458ca8-f76c-432f-84ff-ab64b839c49d] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:40.842550 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-52761605-065e-4441-a9a3-60fccaab6e15 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:40.844240 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-52761605-065e-4441-a9a3-60fccaab6e15 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:40.845540 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-52761605-065e-4441-a9a3-60fccaab6e15 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:40.846592 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-52761605-065e-4441-a9a3-60fccaab6e15 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:41.300468 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-52761605-065e-4441-a9a3-60fccaab6e15 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:41.315841 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-52761605-065e-4441-a9a3-60fccaab6e15 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d" status: 200 len: 1366 microversion: 2.1 time: 0.490438 May 26 16:49:41.317830 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 406/805] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:40 2022] GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d => generated 1366 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:41.741482 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-c0f55246-f251-475a-a3c0-f730b527dcc2 req-88fc6a8b-89a1-400e-b16e-286ee176b81a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d458ca8-f76c-432f-84ff-ab64b839c49d", "tag": "7ecd7624-0f36-4385-b297-434de23e2467"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:49:41.761244 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-c0f55246-f251-475a-a3c0-f730b527dcc2 req-88fc6a8b-89a1-400e-b16e-286ee176b81a service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:41.761706 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-c0f55246-f251-475a-a3c0-f730b527dcc2 req-88fc6a8b-89a1-400e-b16e-286ee176b81a service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:41.777647 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-c0f55246-f251-475a-a3c0-f730b527dcc2 req-88fc6a8b-89a1-400e-b16e-286ee176b81a service nova] Creating event network-changed:7ecd7624-0f36-4385-b297-434de23e2467 for instance 1d458ca8-f76c-432f-84ff-ab64b839c49d on hv-cinder-83607 May 26 16:49:41.783246 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-c0f55246-f251-475a-a3c0-f730b527dcc2 req-88fc6a8b-89a1-400e-b16e-286ee176b81a service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053482 May 26 16:49:41.784219 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 400/806] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:49:42.105222 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-102c98ff-64d1-43fa-a483-fcb1fa72e178 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Action: 'create', calling method: .version_select at 0x7f93a3f03160>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-902784053", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8DlYr/ni8iTCWefPcxY87TtzHz5zDt46PTZE+Q3VhfFNsZGEB5f4WlfKN48ZVX8QjfjUroyCWtBJdntRMnen3CgpAnqVReSgNrK0xSjqwUk1+e18dA90KI4i8azvsRwQ=="}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:49:42.142469 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-102c98ff-64d1-43fa-a483-fcb1fa72e178 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Getting quotas for project 257f08cba99b478db51729bf108ec901. Resources: {'key_pairs'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:49:42.148574 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-102c98ff-64d1-43fa-a483-fcb1fa72e178 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Getting quotas for user 6f7a1fe832af4c83b4b969729d0721e9 and project 257f08cba99b478db51729bf108ec901. Resources: {'key_pairs'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:49:42.193412 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-102c98ff-64d1-43fa-a483-fcb1fa72e178 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.463578 May 26 16:49:42.194316 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 407/807] 10.222.0.102 () {60 vars in 1163 bytes} [Thu May 26 16:49:41 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:49:42.335757 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-20490476-7345-4e45-8e86-9315bc1fb716 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:42.336804 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-20490476-7345-4e45-8e86-9315bc1fb716 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 1d458ca8-f76c-432f-84ff-ab64b839c49d] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:42.344921 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-20490476-7345-4e45-8e86-9315bc1fb716 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:42.345619 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-20490476-7345-4e45-8e86-9315bc1fb716 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:42.347620 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-20490476-7345-4e45-8e86-9315bc1fb716 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:42.348346 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-20490476-7345-4e45-8e86-9315bc1fb716 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:42.637164 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-20490476-7345-4e45-8e86-9315bc1fb716 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:42.658059 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-20490476-7345-4e45-8e86-9315bc1fb716 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d" status: 200 len: 1366 microversion: 2.1 time: 0.326337 May 26 16:49:42.672685 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 401/808] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:42 2022] GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d => generated 1366 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:43.684358 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-208addc2-8989-42c7-9c6f-b0b687a86433 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:43.685108 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-208addc2-8989-42c7-9c6f-b0b687a86433 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 1d458ca8-f76c-432f-84ff-ab64b839c49d] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:43.695023 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-208addc2-8989-42c7-9c6f-b0b687a86433 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:43.695561 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-208addc2-8989-42c7-9c6f-b0b687a86433 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:43.696474 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-208addc2-8989-42c7-9c6f-b0b687a86433 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:43.698104 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-208addc2-8989-42c7-9c6f-b0b687a86433 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:43.989129 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-208addc2-8989-42c7-9c6f-b0b687a86433 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:43.997618 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-208addc2-8989-42c7-9c6f-b0b687a86433 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d" status: 200 len: 1366 microversion: 2.1 time: 0.318776 May 26 16:49:43.998215 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 408/809] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:43 2022] GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d => generated 1366 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:49:45.016238 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-55ee62b5-c7c2-4762-8ec7-17a5955320f7 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:45.017042 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-55ee62b5-c7c2-4762-8ec7-17a5955320f7 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 1d458ca8-f76c-432f-84ff-ab64b839c49d] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:45.030121 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-55ee62b5-c7c2-4762-8ec7-17a5955320f7 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:45.030849 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-55ee62b5-c7c2-4762-8ec7-17a5955320f7 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:45.031733 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-55ee62b5-c7c2-4762-8ec7-17a5955320f7 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:45.032264 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-55ee62b5-c7c2-4762-8ec7-17a5955320f7 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:45.199223 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-55ee62b5-c7c2-4762-8ec7-17a5955320f7 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:45.208364 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-55ee62b5-c7c2-4762-8ec7-17a5955320f7 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d" status: 200 len: 1366 microversion: 2.1 time: 0.197132 May 26 16:49:45.213879 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 402/810] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:45 2022] GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:46.229537 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7e781303-de64-40c2-9ca4-eb712ed428a0 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:46.230448 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-7e781303-de64-40c2-9ca4-eb712ed428a0 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 1d458ca8-f76c-432f-84ff-ab64b839c49d] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:46.237185 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7e781303-de64-40c2-9ca4-eb712ed428a0 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:46.237639 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7e781303-de64-40c2-9ca4-eb712ed428a0 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:46.238435 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7e781303-de64-40c2-9ca4-eb712ed428a0 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:46.238869 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7e781303-de64-40c2-9ca4-eb712ed428a0 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:46.479351 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7e781303-de64-40c2-9ca4-eb712ed428a0 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:46.493360 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7e781303-de64-40c2-9ca4-eb712ed428a0 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d" status: 200 len: 1366 microversion: 2.1 time: 0.268969 May 26 16:49:46.494022 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 409/811] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:46 2022] GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:47.519665 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-a171e6e3-5cc1-43f1-ac22-4b5aae878fbd tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:47.520341 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-a171e6e3-5cc1-43f1-ac22-4b5aae878fbd tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 1d458ca8-f76c-432f-84ff-ab64b839c49d] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:47.524226 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell0:SELECT=2 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:47.530016 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell0:SELECT=6 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:47.544220 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a171e6e3-5cc1-43f1-ac22-4b5aae878fbd tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:47.545063 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a171e6e3-5cc1-43f1-ac22-4b5aae878fbd tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:47.547078 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a171e6e3-5cc1-43f1-ac22-4b5aae878fbd tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:47.547886 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a171e6e3-5cc1-43f1-ac22-4b5aae878fbd tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:47.722582 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-a171e6e3-5cc1-43f1-ac22-4b5aae878fbd tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:47.731402 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-a171e6e3-5cc1-43f1-ac22-4b5aae878fbd tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d" status: 200 len: 1366 microversion: 2.1 time: 0.217414 May 26 16:49:47.731989 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 403/812] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:47 2022] GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:48.750869 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7ba5a865-5a78-4ea7-ba4b-6d29844e3342 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:48.751462 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-7ba5a865-5a78-4ea7-ba4b-6d29844e3342 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 1d458ca8-f76c-432f-84ff-ab64b839c49d] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:48.753882 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:48.760889 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7ba5a865-5a78-4ea7-ba4b-6d29844e3342 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:48.761344 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7ba5a865-5a78-4ea7-ba4b-6d29844e3342 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:48.762122 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7ba5a865-5a78-4ea7-ba4b-6d29844e3342 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:48.762756 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7ba5a865-5a78-4ea7-ba4b-6d29844e3342 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:48.908825 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7ba5a865-5a78-4ea7-ba4b-6d29844e3342 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:48.918231 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7ba5a865-5a78-4ea7-ba4b-6d29844e3342 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d" status: 200 len: 1366 microversion: 2.1 time: 0.172082 May 26 16:49:48.919285 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 410/813] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:48 2022] GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:49.717277 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-d1d367b4-d2d4-463e-b019-21f965eed5f0 req-ffb6ec2e-31d7-45d6-b870-70025b2b3f9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d458ca8-f76c-432f-84ff-ab64b839c49d", "name": "network-vif-plugged", "status": "completed", "tag": "7ecd7624-0f36-4385-b297-434de23e2467"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:49:49.728232 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-d1d367b4-d2d4-463e-b019-21f965eed5f0 req-ffb6ec2e-31d7-45d6-b870-70025b2b3f9a service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:49.728975 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-d1d367b4-d2d4-463e-b019-21f965eed5f0 req-ffb6ec2e-31d7-45d6-b870-70025b2b3f9a service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:49.750287 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-d1d367b4-d2d4-463e-b019-21f965eed5f0 req-ffb6ec2e-31d7-45d6-b870-70025b2b3f9a service nova] Creating event network-vif-plugged:7ecd7624-0f36-4385-b297-434de23e2467 for instance 1d458ca8-f76c-432f-84ff-ab64b839c49d on hv-cinder-83607 May 26 16:49:49.760404 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-d1d367b4-d2d4-463e-b019-21f965eed5f0 req-ffb6ec2e-31d7-45d6-b870-70025b2b3f9a service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047034 May 26 16:49:49.761534 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 404/814] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:49:49.937465 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-b70bbaea-ad1a-4527-aebb-869c0fb10e17 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:49.938212 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-b70bbaea-ad1a-4527-aebb-869c0fb10e17 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 1d458ca8-f76c-432f-84ff-ab64b839c49d] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:49.946838 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b70bbaea-ad1a-4527-aebb-869c0fb10e17 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:49.947308 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b70bbaea-ad1a-4527-aebb-869c0fb10e17 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:49.948130 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b70bbaea-ad1a-4527-aebb-869c0fb10e17 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:49.948768 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b70bbaea-ad1a-4527-aebb-869c0fb10e17 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:50.224526 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b70bbaea-ad1a-4527-aebb-869c0fb10e17 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:50.232957 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-b70bbaea-ad1a-4527-aebb-869c0fb10e17 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d" status: 200 len: 1366 microversion: 2.1 time: 0.299505 May 26 16:49:50.234157 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 411/815] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:49 2022] GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d => generated 1366 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:51.258798 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-d4cb198b-8888-4eca-82e1-b56e85284663 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:51.259591 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-d4cb198b-8888-4eca-82e1-b56e85284663 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 1d458ca8-f76c-432f-84ff-ab64b839c49d] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:51.261584 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:51.267414 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d4cb198b-8888-4eca-82e1-b56e85284663 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:51.267854 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d4cb198b-8888-4eca-82e1-b56e85284663 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:51.268686 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d4cb198b-8888-4eca-82e1-b56e85284663 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:51.269146 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d4cb198b-8888-4eca-82e1-b56e85284663 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:51.272742 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=73 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:51.419116 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-d4cb198b-8888-4eca-82e1-b56e85284663 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:51.427666 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-d4cb198b-8888-4eca-82e1-b56e85284663 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d" status: 200 len: 1366 microversion: 2.1 time: 0.173568 May 26 16:49:51.428256 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 405/816] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:51 2022] GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:52.445744 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-5bc6a8d8-ba64-44e7-99b0-056a0fdfe384 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:52.446365 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-5bc6a8d8-ba64-44e7-99b0-056a0fdfe384 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 1d458ca8-f76c-432f-84ff-ab64b839c49d] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:52.448824 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=10 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:52.455289 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5bc6a8d8-ba64-44e7-99b0-056a0fdfe384 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:52.455748 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5bc6a8d8-ba64-44e7-99b0-056a0fdfe384 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:52.456733 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5bc6a8d8-ba64-44e7-99b0-056a0fdfe384 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:52.457183 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5bc6a8d8-ba64-44e7-99b0-056a0fdfe384 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:52.601969 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-5bc6a8d8-ba64-44e7-99b0-056a0fdfe384 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:52.609907 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-5bc6a8d8-ba64-44e7-99b0-056a0fdfe384 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d" status: 200 len: 1366 microversion: 2.1 time: 0.168236 May 26 16:49:52.610498 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 412/817] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:52 2022] GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:53.630718 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-b701feeb-2a04-418c-bf18-77fb776fbd09 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:53.631635 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-b701feeb-2a04-418c-bf18-77fb776fbd09 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 1d458ca8-f76c-432f-84ff-ab64b839c49d] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:53.640216 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b701feeb-2a04-418c-bf18-77fb776fbd09 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:53.640707 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b701feeb-2a04-418c-bf18-77fb776fbd09 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:53.641552 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b701feeb-2a04-418c-bf18-77fb776fbd09 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:53.641973 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b701feeb-2a04-418c-bf18-77fb776fbd09 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:53.799871 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-b701feeb-2a04-418c-bf18-77fb776fbd09 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:49:53.808580 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-b701feeb-2a04-418c-bf18-77fb776fbd09 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d" status: 200 len: 1553 microversion: 2.1 time: 0.185096 May 26 16:49:53.809161 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 406/818] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:49:53 2022] GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d => generated 1553 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:49:53.827912 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0973b134-babb-4ffd-9496-dcb2f5d3bb00 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:49:53.828544 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0973b134-babb-4ffd-9496-dcb2f5d3bb00 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 1d458ca8-f76c-432f-84ff-ab64b839c49d] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:49:53.837930 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0973b134-babb-4ffd-9496-dcb2f5d3bb00 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:53.838439 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0973b134-babb-4ffd-9496-dcb2f5d3bb00 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:53.839400 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0973b134-babb-4ffd-9496-dcb2f5d3bb00 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:53.839973 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0973b134-babb-4ffd-9496-dcb2f5d3bb00 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:53.923394 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0973b134-babb-4ffd-9496-dcb2f5d3bb00 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101007 May 26 16:49:53.924002 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 413/819] 10.222.0.102 () {58 vars in 1279 bytes} [Thu May 26 16:49:53 2022] GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:49:54.878363 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-7c8e219f-8834-4635-a67f-ddd159027918 req-bb3af9ee-079a-461d-b5c2-c643b5cc5ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d458ca8-f76c-432f-84ff-ab64b839c49d", "tag": "7ecd7624-0f36-4385-b297-434de23e2467"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:49:54.888181 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-7c8e219f-8834-4635-a67f-ddd159027918 req-bb3af9ee-079a-461d-b5c2-c643b5cc5ca1 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:49:54.888676 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-7c8e219f-8834-4635-a67f-ddd159027918 req-bb3af9ee-079a-461d-b5c2-c643b5cc5ca1 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:49:54.900126 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-7c8e219f-8834-4635-a67f-ddd159027918 req-bb3af9ee-079a-461d-b5c2-c643b5cc5ca1 service nova] Creating event network-changed:7ecd7624-0f36-4385-b297-434de23e2467 for instance 1d458ca8-f76c-432f-84ff-ab64b839c49d on hv-cinder-83607 May 26 16:49:54.905509 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-7c8e219f-8834-4635-a67f-ddd159027918 req-bb3af9ee-079a-461d-b5c2-c643b5cc5ca1 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031209 May 26 16:49:54.906164 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 407/820] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:50:18.398407 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=7 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:50:18.399317 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=45 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:50:18.403462 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2671d386-7327-4644-8982-ef6d2aeb04bd tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1003804381", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-902784053", "security_groups": [{"name": "tempest-secgroup-smoke-647515624"}], "block_device_mapping_v2": [{"uuid": "c882ddac-d0cb-4ae8-a4de-c21ce68dc22d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c1d12c9f-73ed-437d-b2a9-5cffbb8cbe3e"}]}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:50:18.524991 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.network.neutron [None req-2671d386-7327-4644-8982-ef6d2aeb04bd tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] validate_networks() for [('c1d12c9f-73ed-437d-b2a9-5cffbb8cbe3e', None, None, None, None, None)] {{(pid=124266) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:50:19.047409 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-2671d386-7327-4644-8982-ef6d2aeb04bd tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Flavor limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:50:19.047835 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-2671d386-7327-4644-8982-ef6d2aeb04bd tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Image limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:50:19.048491 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-2671d386-7327-4644-8982-ef6d2aeb04bd tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Flavor pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:50:19.049107 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-2671d386-7327-4644-8982-ef6d2aeb04bd tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Image pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:50:19.049782 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-2671d386-7327-4644-8982-ef6d2aeb04bd tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:50:19.061633 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2671d386-7327-4644-8982-ef6d2aeb04bd tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:19.062091 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2671d386-7327-4644-8982-ef6d2aeb04bd tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:19.063115 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2671d386-7327-4644-8982-ef6d2aeb04bd tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:19.063560 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2671d386-7327-4644-8982-ef6d2aeb04bd tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:19.088023 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-2671d386-7327-4644-8982-ef6d2aeb04bd tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Getting quotas for project 257f08cba99b478db51729bf108ec901. Resources: {'cores', 'instances', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:50:19.093248 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-2671d386-7327-4644-8982-ef6d2aeb04bd tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Getting quotas for user 6f7a1fe832af4c83b4b969729d0721e9 and project 257f08cba99b478db51729bf108ec901. Resources: {'cores', 'instances', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:50:19.152997 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2671d386-7327-4644-8982-ef6d2aeb04bd tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Going to run 1 instances... {{(pid=124266) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:50:19.155101 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2671d386-7327-4644-8982-ef6d2aeb04bd tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 66738af8-23b3-415c-8352-519823df5647] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c882ddac-d0cb-4ae8-a4de-c21ce68dc22d',volume_size=None,volume_type=None)] {{(pid=124266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:50:19.299894 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2671d386-7327-4644-8982-ef6d2aeb04bd tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.902833 May 26 16:50:19.300521 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 414/821] 10.222.0.102 () {60 vars in 1151 bytes} [Thu May 26 16:50:18 2022] POST /compute/v2.1/servers => generated 407 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 16:50:19.309146 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_api:SELECT=5 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:50:19.311158 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=13 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:50:19.317606 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-9a506b57-f450-4535-a471-4e3ff746bd34 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:50:19.318629 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-9a506b57-f450-4535-a471-4e3ff746bd34 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 66738af8-23b3-415c-8352-519823df5647] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:50:19.385734 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-9a506b57-f450-4535-a471-4e3ff746bd34 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:19.394536 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-9a506b57-f450-4535-a471-4e3ff746bd34 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647" status: 200 len: 1097 microversion: 2.1 time: 0.087255 May 26 16:50:19.398775 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 408/822] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:50:19 2022] GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647 => generated 1097 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:50:20.411834 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2230707f-fb89-4c4b-9bd5-b82c03b8be9a tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:50:20.412668 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2230707f-fb89-4c4b-9bd5-b82c03b8be9a tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 66738af8-23b3-415c-8352-519823df5647] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:50:20.421343 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2230707f-fb89-4c4b-9bd5-b82c03b8be9a tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:20.421978 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2230707f-fb89-4c4b-9bd5-b82c03b8be9a tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:20.422841 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2230707f-fb89-4c4b-9bd5-b82c03b8be9a tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:20.423444 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2230707f-fb89-4c4b-9bd5-b82c03b8be9a tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:20.496913 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-2230707f-fb89-4c4b-9bd5-b82c03b8be9a tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:20.504484 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2230707f-fb89-4c4b-9bd5-b82c03b8be9a tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647" status: 200 len: 1213 microversion: 2.1 time: 0.097038 May 26 16:50:20.505059 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 415/823] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:50:20 2022] GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647 => generated 1213 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:50:21.522395 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-d33f7994-7ab9-4344-b050-39f1b7ddd8e0 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:50:21.522994 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-d33f7994-7ab9-4344-b050-39f1b7ddd8e0 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 66738af8-23b3-415c-8352-519823df5647] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:50:21.537098 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d33f7994-7ab9-4344-b050-39f1b7ddd8e0 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:21.537316 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d33f7994-7ab9-4344-b050-39f1b7ddd8e0 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:21.538815 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d33f7994-7ab9-4344-b050-39f1b7ddd8e0 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:21.539495 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d33f7994-7ab9-4344-b050-39f1b7ddd8e0 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:22.075249 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-d33f7994-7ab9-4344-b050-39f1b7ddd8e0 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:22.082863 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-d33f7994-7ab9-4344-b050-39f1b7ddd8e0 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647" status: 200 len: 1280 microversion: 2.1 time: 0.565104 May 26 16:50:22.083448 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 409/824] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:50:21 2022] GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647 => generated 1280 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:50:22.222770 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-95a5836d-aecf-4449-a140-17870f523007 req-46fc7185-6f4d-4d2d-975a-2cf0a85ccc6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66738af8-23b3-415c-8352-519823df5647", "tag": "126beea4-9563-4685-91f9-9c5c1283a96b"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:50:22.233335 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-95a5836d-aecf-4449-a140-17870f523007 req-46fc7185-6f4d-4d2d-975a-2cf0a85ccc6a service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:22.236007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-95a5836d-aecf-4449-a140-17870f523007 req-46fc7185-6f4d-4d2d-975a-2cf0a85ccc6a service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:22.249945 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-95a5836d-aecf-4449-a140-17870f523007 req-46fc7185-6f4d-4d2d-975a-2cf0a85ccc6a service nova] Creating event network-changed:126beea4-9563-4685-91f9-9c5c1283a96b for instance 66738af8-23b3-415c-8352-519823df5647 on hv-cinder-83607 May 26 16:50:22.255287 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-95a5836d-aecf-4449-a140-17870f523007 req-46fc7185-6f4d-4d2d-975a-2cf0a85ccc6a service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043488 May 26 16:50:22.256515 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 416/825] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:50:23.099377 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-933e9ef0-6940-4012-b9b8-870c7dc2d6dd tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:50:23.100004 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-933e9ef0-6940-4012-b9b8-870c7dc2d6dd tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 66738af8-23b3-415c-8352-519823df5647] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:50:23.106931 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-933e9ef0-6940-4012-b9b8-870c7dc2d6dd tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:23.107466 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-933e9ef0-6940-4012-b9b8-870c7dc2d6dd tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:23.108363 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-933e9ef0-6940-4012-b9b8-870c7dc2d6dd tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:23.108827 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-933e9ef0-6940-4012-b9b8-870c7dc2d6dd tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:23.248193 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-933e9ef0-6940-4012-b9b8-870c7dc2d6dd tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:23.255752 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-933e9ef0-6940-4012-b9b8-870c7dc2d6dd tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647" status: 200 len: 1268 microversion: 2.1 time: 0.160236 May 26 16:50:23.256325 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 410/826] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:50:23 2022] GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647 => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:50:24.274006 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a46527ac-3d53-4ff0-9078-e60c5fa27e57 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:50:24.275382 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a46527ac-3d53-4ff0-9078-e60c5fa27e57 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 66738af8-23b3-415c-8352-519823df5647] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:50:24.283243 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a46527ac-3d53-4ff0-9078-e60c5fa27e57 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:24.283761 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a46527ac-3d53-4ff0-9078-e60c5fa27e57 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:24.284705 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a46527ac-3d53-4ff0-9078-e60c5fa27e57 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:24.285336 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a46527ac-3d53-4ff0-9078-e60c5fa27e57 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:24.442880 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a46527ac-3d53-4ff0-9078-e60c5fa27e57 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:24.450464 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a46527ac-3d53-4ff0-9078-e60c5fa27e57 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647" status: 200 len: 1268 microversion: 2.1 time: 0.180739 May 26 16:50:24.451035 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 417/827] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:50:24 2022] GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647 => generated 1268 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:50:25.467122 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-fb92a803-6534-4779-b8b6-563b59b5f119 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:50:25.467737 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-fb92a803-6534-4779-b8b6-563b59b5f119 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 66738af8-23b3-415c-8352-519823df5647] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:50:25.474300 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fb92a803-6534-4779-b8b6-563b59b5f119 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:25.474746 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fb92a803-6534-4779-b8b6-563b59b5f119 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:25.475526 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fb92a803-6534-4779-b8b6-563b59b5f119 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:25.475972 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fb92a803-6534-4779-b8b6-563b59b5f119 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:25.639448 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-fb92a803-6534-4779-b8b6-563b59b5f119 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:25.647244 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-fb92a803-6534-4779-b8b6-563b59b5f119 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647" status: 200 len: 1268 microversion: 2.1 time: 0.183968 May 26 16:50:25.647832 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 411/828] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:50:25 2022] GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647 => generated 1268 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:50:26.664678 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d703f25c-981c-4574-85f8-982a233e05a9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:50:26.665431 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d703f25c-981c-4574-85f8-982a233e05a9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 66738af8-23b3-415c-8352-519823df5647] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:50:26.672640 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d703f25c-981c-4574-85f8-982a233e05a9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:26.673098 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d703f25c-981c-4574-85f8-982a233e05a9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:26.673889 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d703f25c-981c-4574-85f8-982a233e05a9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:26.674328 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d703f25c-981c-4574-85f8-982a233e05a9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:26.806867 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d703f25c-981c-4574-85f8-982a233e05a9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:26.814961 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d703f25c-981c-4574-85f8-982a233e05a9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647" status: 200 len: 1268 microversion: 2.1 time: 0.154423 May 26 16:50:26.815528 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 418/829] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:50:26 2022] GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647 => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:50:27.832955 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-71b1f9be-8729-4b59-b091-d7b445fb5623 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:50:27.833541 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-71b1f9be-8729-4b59-b091-d7b445fb5623 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 66738af8-23b3-415c-8352-519823df5647] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:50:27.840726 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-71b1f9be-8729-4b59-b091-d7b445fb5623 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:27.841689 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-71b1f9be-8729-4b59-b091-d7b445fb5623 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:27.842454 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-71b1f9be-8729-4b59-b091-d7b445fb5623 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:27.842885 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-71b1f9be-8729-4b59-b091-d7b445fb5623 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:27.983321 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-71b1f9be-8729-4b59-b091-d7b445fb5623 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:27.990850 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-71b1f9be-8729-4b59-b091-d7b445fb5623 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647" status: 200 len: 1268 microversion: 2.1 time: 0.161980 May 26 16:50:27.991414 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 412/830] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:50:27 2022] GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647 => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:50:29.007969 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9005da4e-ea96-471a-a891-5fe94e2eca3c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:50:29.009664 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9005da4e-ea96-471a-a891-5fe94e2eca3c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 66738af8-23b3-415c-8352-519823df5647] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:50:29.016204 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9005da4e-ea96-471a-a891-5fe94e2eca3c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:29.016783 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9005da4e-ea96-471a-a891-5fe94e2eca3c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:29.017578 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9005da4e-ea96-471a-a891-5fe94e2eca3c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:29.018151 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9005da4e-ea96-471a-a891-5fe94e2eca3c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:29.074205 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:50:29.101183 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=6 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:50:29.154119 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9005da4e-ea96-471a-a891-5fe94e2eca3c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:29.161810 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9005da4e-ea96-471a-a891-5fe94e2eca3c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647" status: 200 len: 1268 microversion: 2.1 time: 0.157906 May 26 16:50:29.162389 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 419/831] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:50:29 2022] GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647 => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:50:30.179314 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-d8be01e7-63e9-4cc3-8acd-161dc39f5b2c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:50:30.179846 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-d8be01e7-63e9-4cc3-8acd-161dc39f5b2c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 66738af8-23b3-415c-8352-519823df5647] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:50:30.182197 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell0:SELECT=2 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:50:30.188485 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d8be01e7-63e9-4cc3-8acd-161dc39f5b2c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:30.188865 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d8be01e7-63e9-4cc3-8acd-161dc39f5b2c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:30.189711 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d8be01e7-63e9-4cc3-8acd-161dc39f5b2c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:30.190153 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d8be01e7-63e9-4cc3-8acd-161dc39f5b2c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:30.326267 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-d8be01e7-63e9-4cc3-8acd-161dc39f5b2c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:30.335337 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-d8be01e7-63e9-4cc3-8acd-161dc39f5b2c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647" status: 200 len: 1268 microversion: 2.1 time: 0.160297 May 26 16:50:30.336016 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 413/832] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:50:30 2022] GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647 => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:50:31.353295 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-54d1c7b6-ddda-4aee-b908-5df1520ecf54 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:50:31.353907 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-54d1c7b6-ddda-4aee-b908-5df1520ecf54 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 66738af8-23b3-415c-8352-519823df5647] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:50:31.360972 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-54d1c7b6-ddda-4aee-b908-5df1520ecf54 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:31.361423 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-54d1c7b6-ddda-4aee-b908-5df1520ecf54 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:31.362216 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-54d1c7b6-ddda-4aee-b908-5df1520ecf54 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:31.362654 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-54d1c7b6-ddda-4aee-b908-5df1520ecf54 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:31.496321 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-54d1c7b6-ddda-4aee-b908-5df1520ecf54 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:31.504440 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-54d1c7b6-ddda-4aee-b908-5df1520ecf54 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647" status: 200 len: 1268 microversion: 2.1 time: 0.155034 May 26 16:50:31.505019 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 420/833] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:50:31 2022] GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647 => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:50:32.520433 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-c8c7600c-dbaa-411a-92c9-9beb6bb8aada tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:50:32.521042 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-c8c7600c-dbaa-411a-92c9-9beb6bb8aada tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 66738af8-23b3-415c-8352-519823df5647] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:50:32.527534 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c8c7600c-dbaa-411a-92c9-9beb6bb8aada tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:32.527981 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c8c7600c-dbaa-411a-92c9-9beb6bb8aada tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:32.528779 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c8c7600c-dbaa-411a-92c9-9beb6bb8aada tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:32.529218 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c8c7600c-dbaa-411a-92c9-9beb6bb8aada tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:32.662548 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-c8c7600c-dbaa-411a-92c9-9beb6bb8aada tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:32.670006 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-c8c7600c-dbaa-411a-92c9-9beb6bb8aada tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647" status: 200 len: 1268 microversion: 2.1 time: 0.153502 May 26 16:50:32.670572 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 414/834] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:50:32 2022] GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647 => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:50:33.686500 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f4c743c3-8b2d-41ab-89c5-78f4ecb310a1 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:50:33.687100 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f4c743c3-8b2d-41ab-89c5-78f4ecb310a1 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 66738af8-23b3-415c-8352-519823df5647] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:50:33.693899 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f4c743c3-8b2d-41ab-89c5-78f4ecb310a1 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:33.694347 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f4c743c3-8b2d-41ab-89c5-78f4ecb310a1 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:33.695110 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f4c743c3-8b2d-41ab-89c5-78f4ecb310a1 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:33.695545 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f4c743c3-8b2d-41ab-89c5-78f4ecb310a1 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:33.829396 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f4c743c3-8b2d-41ab-89c5-78f4ecb310a1 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:33.836837 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f4c743c3-8b2d-41ab-89c5-78f4ecb310a1 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647" status: 200 len: 1268 microversion: 2.1 time: 0.154245 May 26 16:50:33.837409 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 421/835] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:50:33 2022] GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647 => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:50:34.854072 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-7a0fc63c-d5b6-4402-a631-c42bb49db0eb tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:50:34.854680 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-7a0fc63c-d5b6-4402-a631-c42bb49db0eb tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 66738af8-23b3-415c-8352-519823df5647] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:50:34.861838 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7a0fc63c-d5b6-4402-a631-c42bb49db0eb tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:34.862287 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7a0fc63c-d5b6-4402-a631-c42bb49db0eb tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:34.863054 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7a0fc63c-d5b6-4402-a631-c42bb49db0eb tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:34.863490 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7a0fc63c-d5b6-4402-a631-c42bb49db0eb tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:34.994582 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-7a0fc63c-d5b6-4402-a631-c42bb49db0eb tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:35.002068 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-7a0fc63c-d5b6-4402-a631-c42bb49db0eb tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647" status: 200 len: 1268 microversion: 2.1 time: 0.151928 May 26 16:50:35.002632 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 415/836] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:50:34 2022] GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647 => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:50:36.018674 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3e337931-d58c-4190-8f15-a24f7bd0ad7f tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:50:36.019279 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-3e337931-d58c-4190-8f15-a24f7bd0ad7f tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 66738af8-23b3-415c-8352-519823df5647] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:50:36.025765 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3e337931-d58c-4190-8f15-a24f7bd0ad7f tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:36.026295 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3e337931-d58c-4190-8f15-a24f7bd0ad7f tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:36.027068 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3e337931-d58c-4190-8f15-a24f7bd0ad7f tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:36.027507 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3e337931-d58c-4190-8f15-a24f7bd0ad7f tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:36.161401 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3e337931-d58c-4190-8f15-a24f7bd0ad7f tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:36.170351 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-3e337931-d58c-4190-8f15-a24f7bd0ad7f tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647" status: 200 len: 1268 microversion: 2.1 time: 0.155562 May 26 16:50:36.170931 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 422/837] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:50:36 2022] GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647 => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:50:37.186870 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-89a22e57-c8a1-48f3-8d63-c5abba04834a tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:50:37.187427 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-89a22e57-c8a1-48f3-8d63-c5abba04834a tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 66738af8-23b3-415c-8352-519823df5647] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:50:37.194839 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-89a22e57-c8a1-48f3-8d63-c5abba04834a tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:37.195295 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-89a22e57-c8a1-48f3-8d63-c5abba04834a tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:37.196083 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-89a22e57-c8a1-48f3-8d63-c5abba04834a tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:37.196550 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-89a22e57-c8a1-48f3-8d63-c5abba04834a tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:37.341286 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-89a22e57-c8a1-48f3-8d63-c5abba04834a tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:37.349587 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-89a22e57-c8a1-48f3-8d63-c5abba04834a tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647" status: 200 len: 1268 microversion: 2.1 time: 0.166771 May 26 16:50:37.350151 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 416/838] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:50:37 2022] GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647 => generated 1268 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:50:37.749030 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-8ddd0601-a807-47c9-92e2-a2aa10a7e80a req-69f2dd25-8be8-42bf-a6f7-ba3dcaa9ad56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66738af8-23b3-415c-8352-519823df5647", "name": "network-vif-plugged", "status": "completed", "tag": "126beea4-9563-4685-91f9-9c5c1283a96b"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:50:37.758167 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-8ddd0601-a807-47c9-92e2-a2aa10a7e80a req-69f2dd25-8be8-42bf-a6f7-ba3dcaa9ad56 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:37.758619 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-8ddd0601-a807-47c9-92e2-a2aa10a7e80a req-69f2dd25-8be8-42bf-a6f7-ba3dcaa9ad56 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:37.770253 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-8ddd0601-a807-47c9-92e2-a2aa10a7e80a req-69f2dd25-8be8-42bf-a6f7-ba3dcaa9ad56 service nova] Creating event network-vif-plugged:126beea4-9563-4685-91f9-9c5c1283a96b for instance 66738af8-23b3-415c-8352-519823df5647 on hv-cinder-83607 May 26 16:50:37.775595 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-8ddd0601-a807-47c9-92e2-a2aa10a7e80a req-69f2dd25-8be8-42bf-a6f7-ba3dcaa9ad56 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030797 May 26 16:50:37.776191 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 423/839] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:50:38.369183 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-838f98fa-4ae9-484f-802f-93a0f0dde3cf tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:50:38.369853 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-838f98fa-4ae9-484f-802f-93a0f0dde3cf tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 66738af8-23b3-415c-8352-519823df5647] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:50:38.377321 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-838f98fa-4ae9-484f-802f-93a0f0dde3cf tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:38.377845 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-838f98fa-4ae9-484f-802f-93a0f0dde3cf tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:38.378654 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-838f98fa-4ae9-484f-802f-93a0f0dde3cf tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:38.379083 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-838f98fa-4ae9-484f-802f-93a0f0dde3cf tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:38.565361 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-838f98fa-4ae9-484f-802f-93a0f0dde3cf tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:38.573401 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-838f98fa-4ae9-484f-802f-93a0f0dde3cf tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647" status: 200 len: 1268 microversion: 2.1 time: 0.208012 May 26 16:50:38.574048 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 417/840] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:50:38 2022] GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647 => generated 1268 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:50:39.592713 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-b6bc0214-adc1-48cf-8285-a15c4294922a tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:50:39.593421 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-b6bc0214-adc1-48cf-8285-a15c4294922a tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 66738af8-23b3-415c-8352-519823df5647] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:50:39.600677 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b6bc0214-adc1-48cf-8285-a15c4294922a tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:39.601132 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b6bc0214-adc1-48cf-8285-a15c4294922a tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:39.601933 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b6bc0214-adc1-48cf-8285-a15c4294922a tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:39.602363 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b6bc0214-adc1-48cf-8285-a15c4294922a tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:39.752201 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b6bc0214-adc1-48cf-8285-a15c4294922a tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:39.760538 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-b6bc0214-adc1-48cf-8285-a15c4294922a tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647" status: 200 len: 1268 microversion: 2.1 time: 0.172296 May 26 16:50:39.761586 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 424/841] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:50:39 2022] GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647 => generated 1268 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:50:40.784673 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-bb68baf9-0db2-4ae5-87c2-6ae273d50072 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:50:40.785306 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-bb68baf9-0db2-4ae5-87c2-6ae273d50072 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 66738af8-23b3-415c-8352-519823df5647] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:50:40.792053 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bb68baf9-0db2-4ae5-87c2-6ae273d50072 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:40.792529 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bb68baf9-0db2-4ae5-87c2-6ae273d50072 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:40.793968 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bb68baf9-0db2-4ae5-87c2-6ae273d50072 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:40.794402 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bb68baf9-0db2-4ae5-87c2-6ae273d50072 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:40.937877 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-bb68baf9-0db2-4ae5-87c2-6ae273d50072 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:40.947146 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-bb68baf9-0db2-4ae5-87c2-6ae273d50072 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647" status: 200 len: 1456 microversion: 2.1 time: 0.166206 May 26 16:50:40.947884 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 418/842] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:50:40 2022] GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647 => generated 1456 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:50:40.963664 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-aa04185f-7f16-4f4c-9650-ccc4acec6bb7 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:50:40.964427 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-aa04185f-7f16-4f4c-9650-ccc4acec6bb7 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 66738af8-23b3-415c-8352-519823df5647] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:50:40.972389 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-aa04185f-7f16-4f4c-9650-ccc4acec6bb7 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:40.973018 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-aa04185f-7f16-4f4c-9650-ccc4acec6bb7 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:40.973844 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-aa04185f-7f16-4f4c-9650-ccc4acec6bb7 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:40.974304 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-aa04185f-7f16-4f4c-9650-ccc4acec6bb7 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:41.118991 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-aa04185f-7f16-4f4c-9650-ccc4acec6bb7 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:41.126982 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-aa04185f-7f16-4f4c-9650-ccc4acec6bb7 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647" status: 200 len: 1456 microversion: 2.1 time: 0.167284 May 26 16:50:41.127567 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 425/843] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:50:40 2022] GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647 => generated 1456 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:50:41.882791 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-3d3bb255-ff16-48cb-b50f-58c3d275126a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:50:41.883347 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-3d3bb255-ff16-48cb-b50f-58c3d275126a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:50:41.890657 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3d3bb255-ff16-48cb-b50f-58c3d275126a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:41.890906 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3d3bb255-ff16-48cb-b50f-58c3d275126a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:41.891924 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3d3bb255-ff16-48cb-b50f-58c3d275126a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:41.892411 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3d3bb255-ff16-48cb-b50f-58c3d275126a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:41.924914 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-3d3bb255-ff16-48cb-b50f-58c3d275126a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea/ips" status: 200 len: 152 microversion: 2.20 time: 0.046216 May 26 16:50:41.925705 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 419/844] 10.222.0.102 () {60 vars in 1293 bytes} [Thu May 26 16:50:41 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea/ips => generated 152 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:50:43.241163 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-113d2952-705d-4ac6-bdb5-7854c1afe140 req-f9b4d51e-b4be-43a9-b356-118d7566a596 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66738af8-23b3-415c-8352-519823df5647", "tag": "126beea4-9563-4685-91f9-9c5c1283a96b"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:50:43.253423 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-113d2952-705d-4ac6-bdb5-7854c1afe140 req-f9b4d51e-b4be-43a9-b356-118d7566a596 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:43.253942 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-113d2952-705d-4ac6-bdb5-7854c1afe140 req-f9b4d51e-b4be-43a9-b356-118d7566a596 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:43.266613 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-113d2952-705d-4ac6-bdb5-7854c1afe140 req-f9b4d51e-b4be-43a9-b356-118d7566a596 service nova] Creating event network-changed:126beea4-9563-4685-91f9-9c5c1283a96b for instance 66738af8-23b3-415c-8352-519823df5647 on hv-cinder-83607 May 26 16:50:43.272133 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-113d2952-705d-4ac6-bdb5-7854c1afe140 req-f9b4d51e-b4be-43a9-b356-118d7566a596 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034574 May 26 16:50:43.273806 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 426/845] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:50:44.532512 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-7ea4e5c0-bb7d-4066-bef0-7e3be31d39e2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:50:44.533067 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-7ea4e5c0-bb7d-4066-bef0-7e3be31d39e2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:50:44.539552 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7ea4e5c0-bb7d-4066-bef0-7e3be31d39e2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:44.539844 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7ea4e5c0-bb7d-4066-bef0-7e3be31d39e2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:44.540673 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7ea4e5c0-bb7d-4066-bef0-7e3be31d39e2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:44.541111 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7ea4e5c0-bb7d-4066-bef0-7e3be31d39e2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:44.572667 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.objects.instance [None req-7ea4e5c0-bb7d-4066-bef0-7e3be31d39e2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lazy-loading 'flavor' on Instance uuid ead585f3-8422-41d8-9a7e-babd902216ea {{(pid=124267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:50:44.858243 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-7ea4e5c0-bb7d-4066-bef0-7e3be31d39e2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "POST /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea/action" status: 202 len: 0 microversion: 2.20 time: 0.329744 May 26 16:50:44.859034 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 420/846] 10.222.0.102 () {62 vars in 1323 bytes} [Thu May 26 16:50:44 2022] POST /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 16:50:44.868144 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-80243685-88ad-4e64-b5bc-da2cf3b5c9fb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:50:44.868878 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-80243685-88ad-4e64-b5bc-da2cf3b5c9fb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:50:44.876008 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-80243685-88ad-4e64-b5bc-da2cf3b5c9fb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:44.876594 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-80243685-88ad-4e64-b5bc-da2cf3b5c9fb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:44.877465 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-80243685-88ad-4e64-b5bc-da2cf3b5c9fb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:44.877953 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-80243685-88ad-4e64-b5bc-da2cf3b5c9fb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:45.018029 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-80243685-88ad-4e64-b5bc-da2cf3b5c9fb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:45.026357 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-80243685-88ad-4e64-b5bc-da2cf3b5c9fb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:45.027925 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-80243685-88ad-4e64-b5bc-da2cf3b5c9fb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:45.029136 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-80243685-88ad-4e64-b5bc-da2cf3b5c9fb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1728 microversion: 2.20 time: 0.165910 May 26 16:50:45.029708 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 427/847] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:50:44 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:50:46.048095 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-b47cef00-a2c6-431b-bcaa-3b37e6ed79ca tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:50:46.048980 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-b47cef00-a2c6-431b-bcaa-3b37e6ed79ca tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:50:46.060899 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b47cef00-a2c6-431b-bcaa-3b37e6ed79ca tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:46.061533 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b47cef00-a2c6-431b-bcaa-3b37e6ed79ca tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:46.062760 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b47cef00-a2c6-431b-bcaa-3b37e6ed79ca tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:46.063533 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b47cef00-a2c6-431b-bcaa-3b37e6ed79ca tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:46.207797 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-b47cef00-a2c6-431b-bcaa-3b37e6ed79ca tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:46.215976 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-b47cef00-a2c6-431b-bcaa-3b37e6ed79ca tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:46.217563 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-b47cef00-a2c6-431b-bcaa-3b37e6ed79ca tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:46.218758 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-b47cef00-a2c6-431b-bcaa-3b37e6ed79ca tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1728 microversion: 2.20 time: 0.175550 May 26 16:50:46.219311 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 421/848] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:50:46 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:50:47.237383 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-20c0b48c-22d2-4e9f-a110-1b5fc9f5cdf7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:50:47.237938 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-20c0b48c-22d2-4e9f-a110-1b5fc9f5cdf7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:50:47.244699 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-20c0b48c-22d2-4e9f-a110-1b5fc9f5cdf7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:47.245154 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-20c0b48c-22d2-4e9f-a110-1b5fc9f5cdf7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:47.245969 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-20c0b48c-22d2-4e9f-a110-1b5fc9f5cdf7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:47.246413 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-20c0b48c-22d2-4e9f-a110-1b5fc9f5cdf7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:47.384072 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-20c0b48c-22d2-4e9f-a110-1b5fc9f5cdf7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:47.394209 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-20c0b48c-22d2-4e9f-a110-1b5fc9f5cdf7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:47.396081 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-20c0b48c-22d2-4e9f-a110-1b5fc9f5cdf7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:47.397311 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-20c0b48c-22d2-4e9f-a110-1b5fc9f5cdf7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1728 microversion: 2.20 time: 0.164126 May 26 16:50:47.397878 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 428/849] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:50:47 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:50:48.420828 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-44d61803-d900-41a6-93fa-4ee24fba8a6d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:50:48.421622 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-44d61803-d900-41a6-93fa-4ee24fba8a6d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:50:48.431697 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-44d61803-d900-41a6-93fa-4ee24fba8a6d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:48.432138 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-44d61803-d900-41a6-93fa-4ee24fba8a6d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:48.432957 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-44d61803-d900-41a6-93fa-4ee24fba8a6d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:48.433898 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-44d61803-d900-41a6-93fa-4ee24fba8a6d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:48.572779 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-44d61803-d900-41a6-93fa-4ee24fba8a6d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:48.581907 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-44d61803-d900-41a6-93fa-4ee24fba8a6d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:48.583406 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-44d61803-d900-41a6-93fa-4ee24fba8a6d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:48.584598 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-44d61803-d900-41a6-93fa-4ee24fba8a6d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1728 microversion: 2.20 time: 0.168095 May 26 16:50:48.585153 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 422/850] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:50:48 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:50:49.603168 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-549f0995-ba82-422f-bf92-ec1570a3df64 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:50:49.603810 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-549f0995-ba82-422f-bf92-ec1570a3df64 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:50:49.606558 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:50:49.612793 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-549f0995-ba82-422f-bf92-ec1570a3df64 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:49.612987 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-549f0995-ba82-422f-bf92-ec1570a3df64 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:49.613782 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-549f0995-ba82-422f-bf92-ec1570a3df64 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:49.614238 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-549f0995-ba82-422f-bf92-ec1570a3df64 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:49.618309 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=75 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:50:49.758083 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-549f0995-ba82-422f-bf92-ec1570a3df64 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:49.767491 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-549f0995-ba82-422f-bf92-ec1570a3df64 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:49.769053 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-549f0995-ba82-422f-bf92-ec1570a3df64 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:49.770475 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-549f0995-ba82-422f-bf92-ec1570a3df64 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1728 microversion: 2.20 time: 0.171145 May 26 16:50:49.771058 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 429/851] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:50:49 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:50:50.788328 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-f2b80159-77b2-4513-938e-77f3ffbbd71a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:50:50.789265 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-f2b80159-77b2-4513-938e-77f3ffbbd71a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:50:50.791761 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_api:SELECT=33 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:50:50.798243 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f2b80159-77b2-4513-938e-77f3ffbbd71a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:50.798704 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f2b80159-77b2-4513-938e-77f3ffbbd71a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:50.799479 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f2b80159-77b2-4513-938e-77f3ffbbd71a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:50.799922 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f2b80159-77b2-4513-938e-77f3ffbbd71a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:50.802562 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:50:50.930588 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-f2b80159-77b2-4513-938e-77f3ffbbd71a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:50.939682 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-f2b80159-77b2-4513-938e-77f3ffbbd71a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:50.941788 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-f2b80159-77b2-4513-938e-77f3ffbbd71a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:50.943553 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-f2b80159-77b2-4513-938e-77f3ffbbd71a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1728 microversion: 2.20 time: 0.158994 May 26 16:50:50.944131 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 423/852] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:50:50 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:50:51.962642 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-11694016-33e8-42da-bbff-4a4884507b3f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:50:51.963206 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-11694016-33e8-42da-bbff-4a4884507b3f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:50:51.970209 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-11694016-33e8-42da-bbff-4a4884507b3f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:51.970654 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-11694016-33e8-42da-bbff-4a4884507b3f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:51.971418 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-11694016-33e8-42da-bbff-4a4884507b3f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:51.971872 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-11694016-33e8-42da-bbff-4a4884507b3f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:52.103401 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-11694016-33e8-42da-bbff-4a4884507b3f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:52.112009 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-11694016-33e8-42da-bbff-4a4884507b3f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:52.113560 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-11694016-33e8-42da-bbff-4a4884507b3f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:52.114744 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-11694016-33e8-42da-bbff-4a4884507b3f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1728 microversion: 2.20 time: 0.156132 May 26 16:50:52.115286 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 430/853] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:50:51 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:50:53.132884 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-88c3b796-59a9-42d1-9dd8-fc6b410de5c1 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:50:53.133490 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-88c3b796-59a9-42d1-9dd8-fc6b410de5c1 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:50:53.140547 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-88c3b796-59a9-42d1-9dd8-fc6b410de5c1 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:53.140999 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-88c3b796-59a9-42d1-9dd8-fc6b410de5c1 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:53.141766 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-88c3b796-59a9-42d1-9dd8-fc6b410de5c1 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:53.142204 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-88c3b796-59a9-42d1-9dd8-fc6b410de5c1 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:53.287910 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-88c3b796-59a9-42d1-9dd8-fc6b410de5c1 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:53.296814 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-88c3b796-59a9-42d1-9dd8-fc6b410de5c1 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:53.298311 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-88c3b796-59a9-42d1-9dd8-fc6b410de5c1 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:53.302270 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-88c3b796-59a9-42d1-9dd8-fc6b410de5c1 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1728 microversion: 2.20 time: 0.173303 May 26 16:50:53.302900 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 424/854] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:50:53 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:50:54.322206 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8e1756f7-f158-4cc4-9a7b-bb5ee238316b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:50:54.322941 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-8e1756f7-f158-4cc4-9a7b-bb5ee238316b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:50:54.329996 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8e1756f7-f158-4cc4-9a7b-bb5ee238316b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:54.330449 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8e1756f7-f158-4cc4-9a7b-bb5ee238316b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:54.331235 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8e1756f7-f158-4cc4-9a7b-bb5ee238316b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:54.331676 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8e1756f7-f158-4cc4-9a7b-bb5ee238316b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:54.460642 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8e1756f7-f158-4cc4-9a7b-bb5ee238316b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:54.468696 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8e1756f7-f158-4cc4-9a7b-bb5ee238316b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:54.470216 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8e1756f7-f158-4cc4-9a7b-bb5ee238316b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:54.471430 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-8e1756f7-f158-4cc4-9a7b-bb5ee238316b tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1728 microversion: 2.20 time: 0.153080 May 26 16:50:54.471990 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 431/855] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:50:54 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:50:55.489913 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-f32648f2-1945-4992-9586-4f45df05a991 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:50:55.490546 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-f32648f2-1945-4992-9586-4f45df05a991 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:50:55.497297 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f32648f2-1945-4992-9586-4f45df05a991 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:55.497749 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f32648f2-1945-4992-9586-4f45df05a991 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:55.498529 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f32648f2-1945-4992-9586-4f45df05a991 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:55.498967 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f32648f2-1945-4992-9586-4f45df05a991 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:55.644404 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-f32648f2-1945-4992-9586-4f45df05a991 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:55.653043 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-f32648f2-1945-4992-9586-4f45df05a991 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:55.654550 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-f32648f2-1945-4992-9586-4f45df05a991 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:55.655727 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-f32648f2-1945-4992-9586-4f45df05a991 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1728 microversion: 2.20 time: 0.169895 May 26 16:50:55.656290 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 425/856] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:50:55 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:50:56.674930 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-69fe00e4-1017-4e62-aa1b-98f562d16b10 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:50:56.675489 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-69fe00e4-1017-4e62-aa1b-98f562d16b10 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:50:56.682386 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-69fe00e4-1017-4e62-aa1b-98f562d16b10 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:56.682858 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-69fe00e4-1017-4e62-aa1b-98f562d16b10 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:56.684148 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-69fe00e4-1017-4e62-aa1b-98f562d16b10 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:56.684611 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-69fe00e4-1017-4e62-aa1b-98f562d16b10 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:56.831679 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-69fe00e4-1017-4e62-aa1b-98f562d16b10 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:56.840409 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-69fe00e4-1017-4e62-aa1b-98f562d16b10 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:56.841918 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-69fe00e4-1017-4e62-aa1b-98f562d16b10 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:56.843107 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-69fe00e4-1017-4e62-aa1b-98f562d16b10 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1728 microversion: 2.20 time: 0.172246 May 26 16:50:56.843674 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 432/857] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:50:56 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:50:57.861318 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-58f88113-6c65-4725-bd55-81e7f53487c2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:50:57.861950 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-58f88113-6c65-4725-bd55-81e7f53487c2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:50:57.868400 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-58f88113-6c65-4725-bd55-81e7f53487c2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:57.868844 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-58f88113-6c65-4725-bd55-81e7f53487c2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:57.869600 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-58f88113-6c65-4725-bd55-81e7f53487c2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:57.870057 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-58f88113-6c65-4725-bd55-81e7f53487c2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:58.006044 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-58f88113-6c65-4725-bd55-81e7f53487c2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:58.014681 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-58f88113-6c65-4725-bd55-81e7f53487c2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:58.016184 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-58f88113-6c65-4725-bd55-81e7f53487c2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:58.017447 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-58f88113-6c65-4725-bd55-81e7f53487c2 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1728 microversion: 2.20 time: 0.160134 May 26 16:50:58.017998 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 426/858] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:50:57 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:50:59.036044 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-cc69d8dc-d3fd-4daf-a1c8-4551f621efa0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:50:59.036667 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-cc69d8dc-d3fd-4daf-a1c8-4551f621efa0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:50:59.043698 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cc69d8dc-d3fd-4daf-a1c8-4551f621efa0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:59.044145 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cc69d8dc-d3fd-4daf-a1c8-4551f621efa0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:59.044969 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cc69d8dc-d3fd-4daf-a1c8-4551f621efa0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:50:59.045408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cc69d8dc-d3fd-4daf-a1c8-4551f621efa0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:50:59.171119 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-cc69d8dc-d3fd-4daf-a1c8-4551f621efa0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:59.179029 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-cc69d8dc-d3fd-4daf-a1c8-4551f621efa0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:59.180557 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-cc69d8dc-d3fd-4daf-a1c8-4551f621efa0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:50:59.181725 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-cc69d8dc-d3fd-4daf-a1c8-4551f621efa0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1728 microversion: 2.20 time: 0.149589 May 26 16:50:59.182287 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 433/859] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:50:59 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:00.201003 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-28a800b0-26ff-441f-84ba-bfcf1bcb0d61 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:00.201565 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-28a800b0-26ff-441f-84ba-bfcf1bcb0d61 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:00.208106 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-28a800b0-26ff-441f-84ba-bfcf1bcb0d61 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:00.208588 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-28a800b0-26ff-441f-84ba-bfcf1bcb0d61 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:00.209357 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-28a800b0-26ff-441f-84ba-bfcf1bcb0d61 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:00.209794 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-28a800b0-26ff-441f-84ba-bfcf1bcb0d61 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:00.457863 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-28a800b0-26ff-441f-84ba-bfcf1bcb0d61 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:00.465813 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-28a800b0-26ff-441f-84ba-bfcf1bcb0d61 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:00.467325 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-28a800b0-26ff-441f-84ba-bfcf1bcb0d61 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:00.468737 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-28a800b0-26ff-441f-84ba-bfcf1bcb0d61 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1728 microversion: 2.20 time: 0.272149 May 26 16:51:00.469068 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 427/860] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:00 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1728 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:01.486452 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1564e5c5-ef94-4850-a3fb-924e30c92a95 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:01.487064 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1564e5c5-ef94-4850-a3fb-924e30c92a95 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:01.493704 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1564e5c5-ef94-4850-a3fb-924e30c92a95 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:01.494156 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1564e5c5-ef94-4850-a3fb-924e30c92a95 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:01.494920 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1564e5c5-ef94-4850-a3fb-924e30c92a95 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:01.496009 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1564e5c5-ef94-4850-a3fb-924e30c92a95 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:01.679421 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1564e5c5-ef94-4850-a3fb-924e30c92a95 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:01.688062 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1564e5c5-ef94-4850-a3fb-924e30c92a95 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:01.689615 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1564e5c5-ef94-4850-a3fb-924e30c92a95 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:01.690765 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1564e5c5-ef94-4850-a3fb-924e30c92a95 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1728 microversion: 2.20 time: 0.208251 May 26 16:51:01.691614 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 434/861] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:01 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1728 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:02.709345 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-c27d4a1b-34f5-4137-a6fd-8a5609f90bfd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:02.709946 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-c27d4a1b-34f5-4137-a6fd-8a5609f90bfd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:02.716569 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c27d4a1b-34f5-4137-a6fd-8a5609f90bfd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:02.717017 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c27d4a1b-34f5-4137-a6fd-8a5609f90bfd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:02.717859 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c27d4a1b-34f5-4137-a6fd-8a5609f90bfd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:02.718312 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c27d4a1b-34f5-4137-a6fd-8a5609f90bfd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:02.845414 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-c27d4a1b-34f5-4137-a6fd-8a5609f90bfd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:02.854352 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-c27d4a1b-34f5-4137-a6fd-8a5609f90bfd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:02.855430 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-c27d4a1b-34f5-4137-a6fd-8a5609f90bfd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:02.856609 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-c27d4a1b-34f5-4137-a6fd-8a5609f90bfd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1728 microversion: 2.20 time: 0.151114 May 26 16:51:02.857163 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 428/862] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:02 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:03.875127 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8c3f0e0b-b7b5-402a-bbb2-1ce62c349b0a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:03.875745 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-8c3f0e0b-b7b5-402a-bbb2-1ce62c349b0a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:03.882411 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8c3f0e0b-b7b5-402a-bbb2-1ce62c349b0a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:03.882868 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8c3f0e0b-b7b5-402a-bbb2-1ce62c349b0a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:03.883676 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8c3f0e0b-b7b5-402a-bbb2-1ce62c349b0a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:03.884118 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8c3f0e0b-b7b5-402a-bbb2-1ce62c349b0a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:04.020203 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8c3f0e0b-b7b5-402a-bbb2-1ce62c349b0a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:04.028206 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8c3f0e0b-b7b5-402a-bbb2-1ce62c349b0a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:04.029743 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8c3f0e0b-b7b5-402a-bbb2-1ce62c349b0a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:04.030920 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-8c3f0e0b-b7b5-402a-bbb2-1ce62c349b0a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1749 microversion: 2.20 time: 0.159764 May 26 16:51:04.031480 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 435/863] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:03 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:05.049410 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-2c8e71f4-71cf-4934-9f39-a5d4a5247bdf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:05.050086 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-2c8e71f4-71cf-4934-9f39-a5d4a5247bdf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:05.056791 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2c8e71f4-71cf-4934-9f39-a5d4a5247bdf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:05.057250 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2c8e71f4-71cf-4934-9f39-a5d4a5247bdf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:05.058029 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2c8e71f4-71cf-4934-9f39-a5d4a5247bdf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:05.058472 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2c8e71f4-71cf-4934-9f39-a5d4a5247bdf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:05.186732 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-2c8e71f4-71cf-4934-9f39-a5d4a5247bdf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:05.195314 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-2c8e71f4-71cf-4934-9f39-a5d4a5247bdf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:05.196859 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-2c8e71f4-71cf-4934-9f39-a5d4a5247bdf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:05.198022 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-2c8e71f4-71cf-4934-9f39-a5d4a5247bdf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1749 microversion: 2.20 time: 0.152602 May 26 16:51:05.199187 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 429/864] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:05 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1749 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:05.880162 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-dc49ebff-c609-43dd-81e9-7a27ada339e3 req-11e99cbb-ebb6-4e32-b015-81909c835387 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead585f3-8422-41d8-9a7e-babd902216ea", "name": "network-vif-plugged", "status": "completed", "tag": "cc45ab72-d2ad-4d48-a593-2e836c66dcb4"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:51:05.890507 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-dc49ebff-c609-43dd-81e9-7a27ada339e3 req-11e99cbb-ebb6-4e32-b015-81909c835387 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:05.891053 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-dc49ebff-c609-43dd-81e9-7a27ada339e3 req-11e99cbb-ebb6-4e32-b015-81909c835387 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:05.902969 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-dc49ebff-c609-43dd-81e9-7a27ada339e3 req-11e99cbb-ebb6-4e32-b015-81909c835387 service nova] Creating event network-vif-plugged:cc45ab72-d2ad-4d48-a593-2e836c66dcb4 for instance ead585f3-8422-41d8-9a7e-babd902216ea on hv-cinder-83607 May 26 16:51:05.908294 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-dc49ebff-c609-43dd-81e9-7a27ada339e3 req-11e99cbb-ebb6-4e32-b015-81909c835387 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032099 May 26 16:51:05.908936 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 436/865] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:51:06.217489 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-41d84488-a5cb-4638-9dbb-1216af8c1b1c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:06.218084 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-41d84488-a5cb-4638-9dbb-1216af8c1b1c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:06.224654 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-41d84488-a5cb-4638-9dbb-1216af8c1b1c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:06.225109 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-41d84488-a5cb-4638-9dbb-1216af8c1b1c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:06.225881 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-41d84488-a5cb-4638-9dbb-1216af8c1b1c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:06.226321 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-41d84488-a5cb-4638-9dbb-1216af8c1b1c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:06.358964 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-41d84488-a5cb-4638-9dbb-1216af8c1b1c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:06.367076 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-41d84488-a5cb-4638-9dbb-1216af8c1b1c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:06.368629 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-41d84488-a5cb-4638-9dbb-1216af8c1b1c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:06.369785 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-41d84488-a5cb-4638-9dbb-1216af8c1b1c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1749 microversion: 2.20 time: 0.156830 May 26 16:51:06.370350 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 430/866] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:06 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:07.390397 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e906a24c-b878-4e2d-bceb-0c3077bf79dc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:07.390983 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e906a24c-b878-4e2d-bceb-0c3077bf79dc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:07.398126 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e906a24c-b878-4e2d-bceb-0c3077bf79dc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:07.398729 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e906a24c-b878-4e2d-bceb-0c3077bf79dc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:07.399580 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e906a24c-b878-4e2d-bceb-0c3077bf79dc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:07.399966 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e906a24c-b878-4e2d-bceb-0c3077bf79dc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:07.539142 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e906a24c-b878-4e2d-bceb-0c3077bf79dc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:07.547645 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e906a24c-b878-4e2d-bceb-0c3077bf79dc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:07.549223 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e906a24c-b878-4e2d-bceb-0c3077bf79dc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:07.550396 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e906a24c-b878-4e2d-bceb-0c3077bf79dc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1749 microversion: 2.20 time: 0.166128 May 26 16:51:07.551042 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 437/867] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:07 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1749 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:08.569801 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-da02f916-c416-4acc-b511-f410a247f98a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:08.570352 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-da02f916-c416-4acc-b511-f410a247f98a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:08.576798 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-da02f916-c416-4acc-b511-f410a247f98a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:08.577286 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-da02f916-c416-4acc-b511-f410a247f98a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:08.578117 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-da02f916-c416-4acc-b511-f410a247f98a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:08.578549 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-da02f916-c416-4acc-b511-f410a247f98a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:08.713235 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-da02f916-c416-4acc-b511-f410a247f98a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:08.721814 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-da02f916-c416-4acc-b511-f410a247f98a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:08.723333 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-da02f916-c416-4acc-b511-f410a247f98a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:08.724518 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-da02f916-c416-4acc-b511-f410a247f98a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1749 microversion: 2.20 time: 0.158972 May 26 16:51:08.725079 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 431/868] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:08 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:51:09.874873 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-42464099-7a8a-4ba6-9f57-406e4e74bb51 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:09.875577 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-42464099-7a8a-4ba6-9f57-406e4e74bb51 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:09.881934 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-42464099-7a8a-4ba6-9f57-406e4e74bb51 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:09.882469 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-42464099-7a8a-4ba6-9f57-406e4e74bb51 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:09.883348 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-42464099-7a8a-4ba6-9f57-406e4e74bb51 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:09.883888 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-42464099-7a8a-4ba6-9f57-406e4e74bb51 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:10.015830 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-42464099-7a8a-4ba6-9f57-406e4e74bb51 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:10.024986 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-42464099-7a8a-4ba6-9f57-406e4e74bb51 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:10.027138 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-42464099-7a8a-4ba6-9f57-406e4e74bb51 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:10.028312 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-42464099-7a8a-4ba6-9f57-406e4e74bb51 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1749 microversion: 2.20 time: 0.289070 May 26 16:51:10.028903 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 438/869] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:09 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1749 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:11.048767 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-ac94885e-43f8-428d-b895-570ad5c44ffd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:11.049583 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-ac94885e-43f8-428d-b895-570ad5c44ffd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:11.056853 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ac94885e-43f8-428d-b895-570ad5c44ffd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:11.057336 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ac94885e-43f8-428d-b895-570ad5c44ffd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:11.058150 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ac94885e-43f8-428d-b895-570ad5c44ffd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:11.058588 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ac94885e-43f8-428d-b895-570ad5c44ffd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:11.188038 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-ac94885e-43f8-428d-b895-570ad5c44ffd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:11.197652 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-ac94885e-43f8-428d-b895-570ad5c44ffd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:11.199685 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-ac94885e-43f8-428d-b895-570ad5c44ffd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:11.200948 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-ac94885e-43f8-428d-b895-570ad5c44ffd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1749 microversion: 2.20 time: 0.157772 May 26 16:51:11.201703 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 432/870] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:11 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:12.220653 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-59ceaa1f-ec00-49df-97a3-9cc9b1f008df tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:12.222013 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-59ceaa1f-ec00-49df-97a3-9cc9b1f008df tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:12.228527 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-59ceaa1f-ec00-49df-97a3-9cc9b1f008df tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:12.229092 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-59ceaa1f-ec00-49df-97a3-9cc9b1f008df tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:12.230702 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-59ceaa1f-ec00-49df-97a3-9cc9b1f008df tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:12.231349 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-59ceaa1f-ec00-49df-97a3-9cc9b1f008df tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:12.385904 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-59ceaa1f-ec00-49df-97a3-9cc9b1f008df tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:12.394544 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-59ceaa1f-ec00-49df-97a3-9cc9b1f008df tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:12.396645 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-59ceaa1f-ec00-49df-97a3-9cc9b1f008df tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:12.397990 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-59ceaa1f-ec00-49df-97a3-9cc9b1f008df tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1744 microversion: 2.20 time: 0.182055 May 26 16:51:12.398549 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 439/871] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:12 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1744 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:13.418260 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-374649e4-ef79-43ff-8f0e-9c5640c53ab0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:13.418948 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-374649e4-ef79-43ff-8f0e-9c5640c53ab0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:13.425373 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-374649e4-ef79-43ff-8f0e-9c5640c53ab0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:13.426145 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-374649e4-ef79-43ff-8f0e-9c5640c53ab0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:13.427150 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-374649e4-ef79-43ff-8f0e-9c5640c53ab0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:13.427678 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-374649e4-ef79-43ff-8f0e-9c5640c53ab0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:13.586799 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-374649e4-ef79-43ff-8f0e-9c5640c53ab0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:13.597042 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-374649e4-ef79-43ff-8f0e-9c5640c53ab0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:13.598786 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-374649e4-ef79-43ff-8f0e-9c5640c53ab0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:13.600050 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-374649e4-ef79-43ff-8f0e-9c5640c53ab0 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1744 microversion: 2.20 time: 0.185918 May 26 16:51:13.608570 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 433/872] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:13 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1744 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:14.618999 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-5dd2cd21-a1e1-4f09-a3d1-a039a3607bf7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:14.620862 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-5dd2cd21-a1e1-4f09-a3d1-a039a3607bf7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:14.628699 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5dd2cd21-a1e1-4f09-a3d1-a039a3607bf7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:14.629517 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5dd2cd21-a1e1-4f09-a3d1-a039a3607bf7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:14.630386 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5dd2cd21-a1e1-4f09-a3d1-a039a3607bf7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:14.631073 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5dd2cd21-a1e1-4f09-a3d1-a039a3607bf7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:14.811426 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-5dd2cd21-a1e1-4f09-a3d1-a039a3607bf7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:14.822939 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-5dd2cd21-a1e1-4f09-a3d1-a039a3607bf7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:14.825020 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-5dd2cd21-a1e1-4f09-a3d1-a039a3607bf7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:14.828689 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-5dd2cd21-a1e1-4f09-a3d1-a039a3607bf7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1744 microversion: 2.20 time: 0.214575 May 26 16:51:14.840540 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 440/873] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:14 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1744 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:15.848138 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-74d22ac2-0fc1-4013-9f26-6ca1fb5484c4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:15.848772 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-74d22ac2-0fc1-4013-9f26-6ca1fb5484c4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:15.855284 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-74d22ac2-0fc1-4013-9f26-6ca1fb5484c4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:15.855734 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-74d22ac2-0fc1-4013-9f26-6ca1fb5484c4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:15.856525 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-74d22ac2-0fc1-4013-9f26-6ca1fb5484c4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:15.856966 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-74d22ac2-0fc1-4013-9f26-6ca1fb5484c4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:16.022083 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-74d22ac2-0fc1-4013-9f26-6ca1fb5484c4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:16.031768 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-74d22ac2-0fc1-4013-9f26-6ca1fb5484c4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:16.033600 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-74d22ac2-0fc1-4013-9f26-6ca1fb5484c4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:16.034990 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-74d22ac2-0fc1-4013-9f26-6ca1fb5484c4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1744 microversion: 2.20 time: 0.190768 May 26 16:51:16.040721 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 434/874] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:15 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1744 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:17.052633 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d4ff3631-17ba-4107-aa13-42aacc25eb49 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:17.053244 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d4ff3631-17ba-4107-aa13-42aacc25eb49 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:17.060064 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d4ff3631-17ba-4107-aa13-42aacc25eb49 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:17.060993 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d4ff3631-17ba-4107-aa13-42aacc25eb49 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:17.061950 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d4ff3631-17ba-4107-aa13-42aacc25eb49 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:17.062550 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d4ff3631-17ba-4107-aa13-42aacc25eb49 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:17.202563 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d4ff3631-17ba-4107-aa13-42aacc25eb49 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:17.211010 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d4ff3631-17ba-4107-aa13-42aacc25eb49 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:17.212913 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d4ff3631-17ba-4107-aa13-42aacc25eb49 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:17.214225 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d4ff3631-17ba-4107-aa13-42aacc25eb49 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1744 microversion: 2.20 time: 0.165495 May 26 16:51:17.214788 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 441/875] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:17 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:51:18.232701 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-35c40ec7-2777-4791-aa2b-96a26f6b8d27 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:18.233302 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-35c40ec7-2777-4791-aa2b-96a26f6b8d27 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:18.239932 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-35c40ec7-2777-4791-aa2b-96a26f6b8d27 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:18.240399 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-35c40ec7-2777-4791-aa2b-96a26f6b8d27 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:18.241186 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-35c40ec7-2777-4791-aa2b-96a26f6b8d27 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:18.241661 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-35c40ec7-2777-4791-aa2b-96a26f6b8d27 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:18.399917 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-35c40ec7-2777-4791-aa2b-96a26f6b8d27 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:18.408672 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-35c40ec7-2777-4791-aa2b-96a26f6b8d27 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:18.411138 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-35c40ec7-2777-4791-aa2b-96a26f6b8d27 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:18.412331 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-35c40ec7-2777-4791-aa2b-96a26f6b8d27 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1744 microversion: 2.20 time: 0.183648 May 26 16:51:18.413217 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 435/876] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:18 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1744 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:19.432194 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ae7ea0ca-7be9-4beb-930f-37c1fd7c1f3d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:19.432822 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ae7ea0ca-7be9-4beb-930f-37c1fd7c1f3d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:19.439834 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ae7ea0ca-7be9-4beb-930f-37c1fd7c1f3d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:19.441069 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ae7ea0ca-7be9-4beb-930f-37c1fd7c1f3d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:19.442134 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ae7ea0ca-7be9-4beb-930f-37c1fd7c1f3d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:19.442753 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ae7ea0ca-7be9-4beb-930f-37c1fd7c1f3d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:19.603718 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ae7ea0ca-7be9-4beb-930f-37c1fd7c1f3d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:19.612930 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ae7ea0ca-7be9-4beb-930f-37c1fd7c1f3d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:19.616199 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ae7ea0ca-7be9-4beb-930f-37c1fd7c1f3d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:19.618137 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ae7ea0ca-7be9-4beb-930f-37c1fd7c1f3d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1744 microversion: 2.20 time: 0.189848 May 26 16:51:19.619933 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 442/877] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:19 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1744 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:51:20.640997 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-32b108ae-edcf-4d00-913c-92d022b142a3 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:20.642586 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-32b108ae-edcf-4d00-913c-92d022b142a3 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:20.650050 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-32b108ae-edcf-4d00-913c-92d022b142a3 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:20.650502 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-32b108ae-edcf-4d00-913c-92d022b142a3 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:20.651934 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-32b108ae-edcf-4d00-913c-92d022b142a3 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:20.652387 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-32b108ae-edcf-4d00-913c-92d022b142a3 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:20.802167 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-32b108ae-edcf-4d00-913c-92d022b142a3 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:20.811434 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-32b108ae-edcf-4d00-913c-92d022b142a3 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:20.813053 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-32b108ae-edcf-4d00-913c-92d022b142a3 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:20.814301 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-32b108ae-edcf-4d00-913c-92d022b142a3 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1744 microversion: 2.20 time: 0.177680 May 26 16:51:20.815109 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 436/878] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:20 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1744 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:21.834315 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0642d709-624a-451e-9c10-120888982d8a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:21.834856 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0642d709-624a-451e-9c10-120888982d8a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:21.837400 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=28 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:51:21.843722 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0642d709-624a-451e-9c10-120888982d8a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:21.844179 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0642d709-624a-451e-9c10-120888982d8a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:21.844986 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0642d709-624a-451e-9c10-120888982d8a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:21.845429 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0642d709-624a-451e-9c10-120888982d8a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:21.848230 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=80 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:51:21.973057 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0642d709-624a-451e-9c10-120888982d8a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:21.980919 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0642d709-624a-451e-9c10-120888982d8a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:21.982426 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0642d709-624a-451e-9c10-120888982d8a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:21.983593 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0642d709-624a-451e-9c10-120888982d8a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1744 microversion: 2.20 time: 0.153396 May 26 16:51:21.984150 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 443/879] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:21 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:23.001819 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-7b3eb822-d5ed-4b5d-bbe8-64b05f40c900 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:23.002724 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-7b3eb822-d5ed-4b5d-bbe8-64b05f40c900 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:23.005264 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_api:SELECT=28 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:51:23.011149 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7b3eb822-d5ed-4b5d-bbe8-64b05f40c900 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:23.011598 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7b3eb822-d5ed-4b5d-bbe8-64b05f40c900 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:23.012772 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7b3eb822-d5ed-4b5d-bbe8-64b05f40c900 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:23.013243 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7b3eb822-d5ed-4b5d-bbe8-64b05f40c900 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:23.016781 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=84 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:51:23.152089 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-7b3eb822-d5ed-4b5d-bbe8-64b05f40c900 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:23.160022 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-7b3eb822-d5ed-4b5d-bbe8-64b05f40c900 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:23.161577 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-7b3eb822-d5ed-4b5d-bbe8-64b05f40c900 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:23.162741 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-7b3eb822-d5ed-4b5d-bbe8-64b05f40c900 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1744 microversion: 2.20 time: 0.164985 May 26 16:51:23.163311 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 437/880] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:22 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:24.181091 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-41187572-b17e-45fa-a55b-51ef57bb87bb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:24.181701 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-41187572-b17e-45fa-a55b-51ef57bb87bb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:24.188955 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-41187572-b17e-45fa-a55b-51ef57bb87bb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:24.189406 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-41187572-b17e-45fa-a55b-51ef57bb87bb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:24.190176 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-41187572-b17e-45fa-a55b-51ef57bb87bb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:24.190884 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-41187572-b17e-45fa-a55b-51ef57bb87bb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:24.319037 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-41187572-b17e-45fa-a55b-51ef57bb87bb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:24.326976 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-41187572-b17e-45fa-a55b-51ef57bb87bb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:24.328503 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-41187572-b17e-45fa-a55b-51ef57bb87bb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:24.329663 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-41187572-b17e-45fa-a55b-51ef57bb87bb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1744 microversion: 2.20 time: 0.152539 May 26 16:51:24.330218 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 444/881] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:24 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:25.348086 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-d655debf-2cb3-45e9-bbfe-6b2eee8fc754 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:25.348723 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-d655debf-2cb3-45e9-bbfe-6b2eee8fc754 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:25.355872 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d655debf-2cb3-45e9-bbfe-6b2eee8fc754 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:25.356321 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d655debf-2cb3-45e9-bbfe-6b2eee8fc754 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:25.357118 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d655debf-2cb3-45e9-bbfe-6b2eee8fc754 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:25.357557 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d655debf-2cb3-45e9-bbfe-6b2eee8fc754 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:25.487212 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-d655debf-2cb3-45e9-bbfe-6b2eee8fc754 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:25.495630 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-d655debf-2cb3-45e9-bbfe-6b2eee8fc754 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:25.497178 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-d655debf-2cb3-45e9-bbfe-6b2eee8fc754 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:25.498346 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-d655debf-2cb3-45e9-bbfe-6b2eee8fc754 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1744 microversion: 2.20 time: 0.154168 May 26 16:51:25.498907 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 438/882] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:25 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:26.516537 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8e7c451e-d971-4875-b358-98d01ee3b749 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:26.517147 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-8e7c451e-d971-4875-b358-98d01ee3b749 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:26.523600 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8e7c451e-d971-4875-b358-98d01ee3b749 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:26.524051 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8e7c451e-d971-4875-b358-98d01ee3b749 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:26.524854 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8e7c451e-d971-4875-b358-98d01ee3b749 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:26.525293 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8e7c451e-d971-4875-b358-98d01ee3b749 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:26.655839 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8e7c451e-d971-4875-b358-98d01ee3b749 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:26.663750 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8e7c451e-d971-4875-b358-98d01ee3b749 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:26.665302 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8e7c451e-d971-4875-b358-98d01ee3b749 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:26.666795 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-8e7c451e-d971-4875-b358-98d01ee3b749 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1744 microversion: 2.20 time: 0.154076 May 26 16:51:26.667015 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 445/883] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:26 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:27.684185 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-734d05ec-bec7-4deb-beab-6f0c1ea07d16 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:27.684843 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-734d05ec-bec7-4deb-beab-6f0c1ea07d16 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:27.694163 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-734d05ec-bec7-4deb-beab-6f0c1ea07d16 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:27.694696 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-734d05ec-bec7-4deb-beab-6f0c1ea07d16 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:27.695468 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-734d05ec-bec7-4deb-beab-6f0c1ea07d16 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:27.695901 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-734d05ec-bec7-4deb-beab-6f0c1ea07d16 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:27.939062 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-734d05ec-bec7-4deb-beab-6f0c1ea07d16 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:27.953314 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-734d05ec-bec7-4deb-beab-6f0c1ea07d16 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:27.954882 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-734d05ec-bec7-4deb-beab-6f0c1ea07d16 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:27.956128 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-734d05ec-bec7-4deb-beab-6f0c1ea07d16 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1726 microversion: 2.20 time: 0.275949 May 26 16:51:27.956725 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 439/884] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:27 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1726 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:28.974487 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-173f9913-ec41-40c5-8a8f-5d42ffa33ee8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:28.975099 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-173f9913-ec41-40c5-8a8f-5d42ffa33ee8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:28.982234 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-173f9913-ec41-40c5-8a8f-5d42ffa33ee8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:28.982682 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-173f9913-ec41-40c5-8a8f-5d42ffa33ee8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:28.983450 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-173f9913-ec41-40c5-8a8f-5d42ffa33ee8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:28.983884 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-173f9913-ec41-40c5-8a8f-5d42ffa33ee8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:29.129545 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-173f9913-ec41-40c5-8a8f-5d42ffa33ee8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:29.139665 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-173f9913-ec41-40c5-8a8f-5d42ffa33ee8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:29.142060 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-173f9913-ec41-40c5-8a8f-5d42ffa33ee8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:29.143809 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-173f9913-ec41-40c5-8a8f-5d42ffa33ee8 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1726 microversion: 2.20 time: 0.172974 May 26 16:51:29.144406 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 446/885] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:28 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1726 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:30.164687 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-f37336bf-f7d1-40ca-9c9f-175f65d57f1a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:30.165328 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-f37336bf-f7d1-40ca-9c9f-175f65d57f1a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:30.171869 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f37336bf-f7d1-40ca-9c9f-175f65d57f1a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:30.172312 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f37336bf-f7d1-40ca-9c9f-175f65d57f1a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:30.173103 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f37336bf-f7d1-40ca-9c9f-175f65d57f1a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:30.173541 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f37336bf-f7d1-40ca-9c9f-175f65d57f1a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:30.300538 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-f37336bf-f7d1-40ca-9c9f-175f65d57f1a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:30.310295 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-f37336bf-f7d1-40ca-9c9f-175f65d57f1a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:30.311827 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-f37336bf-f7d1-40ca-9c9f-175f65d57f1a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:30.313049 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-f37336bf-f7d1-40ca-9c9f-175f65d57f1a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1726 microversion: 2.20 time: 0.152446 May 26 16:51:30.313612 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 440/886] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:30 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:30.857861 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-10edba48-ed0f-426c-8644-f8858fcbf4c1 req-8834085a-1114-4513-8fd1-c25a43999a91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead585f3-8422-41d8-9a7e-babd902216ea", "name": "network-vif-unplugged", "status": "completed", "tag": "cc45ab72-d2ad-4d48-a593-2e836c66dcb4"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:51:30.866849 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-10edba48-ed0f-426c-8644-f8858fcbf4c1 req-8834085a-1114-4513-8fd1-c25a43999a91 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:30.867298 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-10edba48-ed0f-426c-8644-f8858fcbf4c1 req-8834085a-1114-4513-8fd1-c25a43999a91 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:30.878924 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-10edba48-ed0f-426c-8644-f8858fcbf4c1 req-8834085a-1114-4513-8fd1-c25a43999a91 service nova] Creating event network-vif-unplugged:cc45ab72-d2ad-4d48-a593-2e836c66dcb4 for instance ead585f3-8422-41d8-9a7e-babd902216ea on hv-cinder-83607 May 26 16:51:30.883847 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-10edba48-ed0f-426c-8644-f8858fcbf4c1 req-8834085a-1114-4513-8fd1-c25a43999a91 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029699 May 26 16:51:30.884713 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 447/887] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:51:31.331008 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-7566aaef-4d57-415c-958f-e4abf7b175b4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:31.332027 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-7566aaef-4d57-415c-958f-e4abf7b175b4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:31.338890 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7566aaef-4d57-415c-958f-e4abf7b175b4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:31.339332 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7566aaef-4d57-415c-958f-e4abf7b175b4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:31.340096 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7566aaef-4d57-415c-958f-e4abf7b175b4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:31.340565 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7566aaef-4d57-415c-958f-e4abf7b175b4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:31.467082 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-7566aaef-4d57-415c-958f-e4abf7b175b4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:31.474971 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-7566aaef-4d57-415c-958f-e4abf7b175b4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:31.476534 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-7566aaef-4d57-415c-958f-e4abf7b175b4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:31.477731 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-7566aaef-4d57-415c-958f-e4abf7b175b4 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1726 microversion: 2.20 time: 0.150865 May 26 16:51:31.478294 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 441/888] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:31 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:32.498705 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-bcb39366-a589-407b-88f3-d8d2558320fe tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:32.499467 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-bcb39366-a589-407b-88f3-d8d2558320fe tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:32.514054 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bcb39366-a589-407b-88f3-d8d2558320fe tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:32.514715 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bcb39366-a589-407b-88f3-d8d2558320fe tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:32.515868 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bcb39366-a589-407b-88f3-d8d2558320fe tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:32.516551 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bcb39366-a589-407b-88f3-d8d2558320fe tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:32.918691 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-bcb39366-a589-407b-88f3-d8d2558320fe tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:32.931044 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-bcb39366-a589-407b-88f3-d8d2558320fe tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:32.932597 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-bcb39366-a589-407b-88f3-d8d2558320fe tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:32.933774 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-bcb39366-a589-407b-88f3-d8d2558320fe tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1726 microversion: 2.20 time: 0.440776 May 26 16:51:32.934335 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 448/889] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:32 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1726 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:33.958195 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-6bcbe3e9-d54d-44c1-82fb-aa68d57f4d6d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:33.958794 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-6bcbe3e9-d54d-44c1-82fb-aa68d57f4d6d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:33.965519 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-6bcbe3e9-d54d-44c1-82fb-aa68d57f4d6d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:33.966011 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-6bcbe3e9-d54d-44c1-82fb-aa68d57f4d6d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:33.966780 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-6bcbe3e9-d54d-44c1-82fb-aa68d57f4d6d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:33.967215 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-6bcbe3e9-d54d-44c1-82fb-aa68d57f4d6d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:34.096955 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-6bcbe3e9-d54d-44c1-82fb-aa68d57f4d6d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:34.105811 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-6bcbe3e9-d54d-44c1-82fb-aa68d57f4d6d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:34.107818 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-6bcbe3e9-d54d-44c1-82fb-aa68d57f4d6d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:34.109338 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-6bcbe3e9-d54d-44c1-82fb-aa68d57f4d6d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1726 microversion: 2.20 time: 0.155079 May 26 16:51:34.110058 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 442/890] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:33 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:51:35.129161 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9626efdb-695d-46cb-98bb-f4b135ea99d1 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:35.129773 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9626efdb-695d-46cb-98bb-f4b135ea99d1 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:35.137261 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9626efdb-695d-46cb-98bb-f4b135ea99d1 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:35.137994 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9626efdb-695d-46cb-98bb-f4b135ea99d1 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:35.139267 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9626efdb-695d-46cb-98bb-f4b135ea99d1 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:35.139696 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9626efdb-695d-46cb-98bb-f4b135ea99d1 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:35.277876 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9626efdb-695d-46cb-98bb-f4b135ea99d1 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:35.289575 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9626efdb-695d-46cb-98bb-f4b135ea99d1 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:35.292337 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9626efdb-695d-46cb-98bb-f4b135ea99d1 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:35.294677 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9626efdb-695d-46cb-98bb-f4b135ea99d1 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1669 microversion: 2.20 time: 0.170237 May 26 16:51:35.295355 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 449/891] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:35 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1669 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:35.318205 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-f06c6486-90c4-4878-aff4-ceff689a3b41 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a40dd6a-2a74-4991-b286-b36f38dea358"}} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:51:35.319433 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-f06c6486-90c4-4878-aff4-ceff689a3b41 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:35.326316 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f06c6486-90c4-4878-aff4-ceff689a3b41 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:35.326763 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f06c6486-90c4-4878-aff4-ceff689a3b41 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:35.327545 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f06c6486-90c4-4878-aff4-ceff689a3b41 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:35.327989 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f06c6486-90c4-4878-aff4-ceff689a3b41 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:35.633398 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-f06c6486-90c4-4878-aff4-ceff689a3b41 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "POST /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.322853 May 26 16:51:35.634048 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 443/892] 10.222.0.102 () {62 vars in 1368 bytes} [Thu May 26 16:51:35 2022] POST /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea/os-volume_attachments => generated 188 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:51:35.752689 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-287fb4bf-e85a-4310-9147-e8a5d1cb4269 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:35.753190 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-287fb4bf-e85a-4310-9147-e8a5d1cb4269 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:35.759401 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-287fb4bf-e85a-4310-9147-e8a5d1cb4269 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:35.759848 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-287fb4bf-e85a-4310-9147-e8a5d1cb4269 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:35.760648 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-287fb4bf-e85a-4310-9147-e8a5d1cb4269 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:35.761081 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-287fb4bf-e85a-4310-9147-e8a5d1cb4269 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:36.063129 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-287fb4bf-e85a-4310-9147-e8a5d1cb4269 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "DELETE /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea/os-volume_attachments/5a40dd6a-2a74-4991-b286-b36f38dea358" status: 202 len: 0 microversion: 2.20 time: 0.314182 May 26 16:51:36.063997 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 450/893] 10.222.0.102 () {60 vars in 1461 bytes} [Thu May 26 16:51:35 2022] DELETE /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea/os-volume_attachments/5a40dd6a-2a74-4991-b286-b36f38dea358 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 26 16:51:36.130297 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-11be18e1-9e20-4c58-9890-01618d542749 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:51:36.131212 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-11be18e1-9e20-4c58-9890-01618d542749 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:36.138765 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-11be18e1-9e20-4c58-9890-01618d542749 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:36.139212 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-11be18e1-9e20-4c58-9890-01618d542749 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:36.139998 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-11be18e1-9e20-4c58-9890-01618d542749 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:36.140471 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-11be18e1-9e20-4c58-9890-01618d542749 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:36.242380 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-11be18e1-9e20-4c58-9890-01618d542749 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "POST /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea/action" status: 202 len: 0 microversion: 2.20 time: 0.117520 May 26 16:51:36.243167 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 444/894] 10.222.0.102 () {62 vars in 1323 bytes} [Thu May 26 16:51:36 2022] POST /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 16:51:36.252011 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7252ba07-a694-49d1-aef0-97a78789767d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:36.253088 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-7252ba07-a694-49d1-aef0-97a78789767d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:36.262578 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7252ba07-a694-49d1-aef0-97a78789767d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:36.262578 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7252ba07-a694-49d1-aef0-97a78789767d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:36.263615 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7252ba07-a694-49d1-aef0-97a78789767d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:36.264064 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7252ba07-a694-49d1-aef0-97a78789767d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:36.411514 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7252ba07-a694-49d1-aef0-97a78789767d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:36.420761 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7252ba07-a694-49d1-aef0-97a78789767d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:36.422458 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7252ba07-a694-49d1-aef0-97a78789767d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:36.423739 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7252ba07-a694-49d1-aef0-97a78789767d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1677 microversion: 2.20 time: 0.175849 May 26 16:51:36.424409 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 451/895] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:36 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:37.444327 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-65282f41-e608-4b90-a2ba-c0a1051ea7fe tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:37.445084 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-65282f41-e608-4b90-a2ba-c0a1051ea7fe tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:37.453526 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-65282f41-e608-4b90-a2ba-c0a1051ea7fe tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:37.453982 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-65282f41-e608-4b90-a2ba-c0a1051ea7fe tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:37.454779 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-65282f41-e608-4b90-a2ba-c0a1051ea7fe tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:37.455225 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-65282f41-e608-4b90-a2ba-c0a1051ea7fe tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:37.595724 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-65282f41-e608-4b90-a2ba-c0a1051ea7fe tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:37.604121 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-65282f41-e608-4b90-a2ba-c0a1051ea7fe tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:37.605763 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-65282f41-e608-4b90-a2ba-c0a1051ea7fe tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:37.606979 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-65282f41-e608-4b90-a2ba-c0a1051ea7fe tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1679 microversion: 2.20 time: 0.167739 May 26 16:51:37.607545 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 445/896] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:37 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:38.624882 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1ad606d5-c3a6-4474-b2c9-520102544940 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:38.625518 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1ad606d5-c3a6-4474-b2c9-520102544940 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:38.632356 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1ad606d5-c3a6-4474-b2c9-520102544940 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:38.632833 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1ad606d5-c3a6-4474-b2c9-520102544940 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:38.633740 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1ad606d5-c3a6-4474-b2c9-520102544940 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:38.634275 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1ad606d5-c3a6-4474-b2c9-520102544940 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:38.766311 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1ad606d5-c3a6-4474-b2c9-520102544940 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:38.774867 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1ad606d5-c3a6-4474-b2c9-520102544940 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:38.776363 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1ad606d5-c3a6-4474-b2c9-520102544940 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:38.777648 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1ad606d5-c3a6-4474-b2c9-520102544940 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1735 microversion: 2.20 time: 0.156738 May 26 16:51:38.778210 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 452/897] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:38 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:39.798897 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-bfa7cf06-6de0-4063-ba47-52463d5fe43a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:39.800120 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-bfa7cf06-6de0-4063-ba47-52463d5fe43a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:39.808727 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bfa7cf06-6de0-4063-ba47-52463d5fe43a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:39.809832 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bfa7cf06-6de0-4063-ba47-52463d5fe43a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:39.810908 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bfa7cf06-6de0-4063-ba47-52463d5fe43a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:39.811512 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bfa7cf06-6de0-4063-ba47-52463d5fe43a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:40.024985 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-bfa7cf06-6de0-4063-ba47-52463d5fe43a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:40.034929 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-bfa7cf06-6de0-4063-ba47-52463d5fe43a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:40.037072 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-bfa7cf06-6de0-4063-ba47-52463d5fe43a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:40.038634 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-bfa7cf06-6de0-4063-ba47-52463d5fe43a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1735 microversion: 2.20 time: 0.247086 May 26 16:51:40.039673 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 446/898] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:39 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1735 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:41.058443 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-41b10335-05ce-488f-b61e-b9cfb7d2c0d7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:41.059394 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-41b10335-05ce-488f-b61e-b9cfb7d2c0d7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:41.066493 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-41b10335-05ce-488f-b61e-b9cfb7d2c0d7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:41.066947 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-41b10335-05ce-488f-b61e-b9cfb7d2c0d7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:41.067763 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-41b10335-05ce-488f-b61e-b9cfb7d2c0d7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:41.068233 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-41b10335-05ce-488f-b61e-b9cfb7d2c0d7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:41.231468 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-41b10335-05ce-488f-b61e-b9cfb7d2c0d7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:41.248552 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-41b10335-05ce-488f-b61e-b9cfb7d2c0d7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:41.251812 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-41b10335-05ce-488f-b61e-b9cfb7d2c0d7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:41.255256 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-41b10335-05ce-488f-b61e-b9cfb7d2c0d7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1735 microversion: 2.20 time: 0.200356 May 26 16:51:41.257537 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 453/899] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:41 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1735 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:42.276117 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-c1dad042-053b-4cfb-aee6-17014fbc2818 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:42.276897 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-c1dad042-053b-4cfb-aee6-17014fbc2818 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:42.284888 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c1dad042-053b-4cfb-aee6-17014fbc2818 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:42.285227 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c1dad042-053b-4cfb-aee6-17014fbc2818 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:42.286245 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c1dad042-053b-4cfb-aee6-17014fbc2818 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:42.286832 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c1dad042-053b-4cfb-aee6-17014fbc2818 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:42.460995 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-508607af-89e5-4f1e-a4d6-a4918db5dc5b tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:42.461543 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-508607af-89e5-4f1e-a4d6-a4918db5dc5b tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:42.475734 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-508607af-89e5-4f1e-a4d6-a4918db5dc5b tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:42.476457 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-508607af-89e5-4f1e-a4d6-a4918db5dc5b tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:42.477449 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-508607af-89e5-4f1e-a4d6-a4918db5dc5b tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:42.478047 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-508607af-89e5-4f1e-a4d6-a4918db5dc5b tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:42.489428 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-c1dad042-053b-4cfb-aee6-17014fbc2818 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:42.500504 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-c1dad042-053b-4cfb-aee6-17014fbc2818 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:42.502569 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-c1dad042-053b-4cfb-aee6-17014fbc2818 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:42.503837 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-c1dad042-053b-4cfb-aee6-17014fbc2818 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1735 microversion: 2.20 time: 0.231922 May 26 16:51:42.504446 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 447/900] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:42 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1735 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:51:42.510360 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-ee90d4fe-e9d4-482b-993f-23ed262d3df0 req-c95df00f-7389-49d9-aa4f-1512a1409642 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "898074a4-2c24-403a-bdd9-e9809f6375fd", "tag": "a5a3472f-1b24-4c5b-ada9-48c5e198da12"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:51:42.520448 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-508607af-89e5-4f1e-a4d6-a4918db5dc5b tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Going to try to terminate instance {{(pid=124266) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 16:51:42.533195 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-ee90d4fe-e9d4-482b-993f-23ed262d3df0 req-c95df00f-7389-49d9-aa4f-1512a1409642 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:42.533645 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-ee90d4fe-e9d4-482b-993f-23ed262d3df0 req-c95df00f-7389-49d9-aa4f-1512a1409642 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:42.548690 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-ee90d4fe-e9d4-482b-993f-23ed262d3df0 req-c95df00f-7389-49d9-aa4f-1512a1409642 service nova] Creating event network-changed:a5a3472f-1b24-4c5b-ada9-48c5e198da12 for instance 898074a4-2c24-403a-bdd9-e9809f6375fd on hv-cinder-83607 May 26 16:51:42.556727 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-ee90d4fe-e9d4-482b-993f-23ed262d3df0 req-c95df00f-7389-49d9-aa4f-1512a1409642 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050975 May 26 16:51:42.559166 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 448/901] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:51:42.630669 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-508607af-89e5-4f1e-a4d6-a4918db5dc5b tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "DELETE /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 204 len: 0 microversion: 2.1 time: 0.174135 May 26 16:51:42.631458 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 454/902] 10.222.0.102 () {58 vars in 1243 bytes} [Thu May 26 16:51:42 2022] DELETE /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 16:51:42.641351 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-fb97bb69-9b48-4bce-a9ff-5887626eaf38 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:42.642255 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-fb97bb69-9b48-4bce-a9ff-5887626eaf38 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:42.654332 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fb97bb69-9b48-4bce-a9ff-5887626eaf38 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:42.655336 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fb97bb69-9b48-4bce-a9ff-5887626eaf38 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:42.656173 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fb97bb69-9b48-4bce-a9ff-5887626eaf38 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:42.656783 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fb97bb69-9b48-4bce-a9ff-5887626eaf38 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:42.836327 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-fb97bb69-9b48-4bce-a9ff-5887626eaf38 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:42.857894 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-fb97bb69-9b48-4bce-a9ff-5887626eaf38 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1572 microversion: 2.1 time: 0.221809 May 26 16:51:42.859197 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 449/903] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:51:42 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1572 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:51:43.523781 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-577dc358-3d71-47f4-a73a-d743d0bd7d8c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:43.524612 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-577dc358-3d71-47f4-a73a-d743d0bd7d8c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:43.532589 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-577dc358-3d71-47f4-a73a-d743d0bd7d8c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:43.533144 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-577dc358-3d71-47f4-a73a-d743d0bd7d8c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:43.534009 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-577dc358-3d71-47f4-a73a-d743d0bd7d8c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:43.534523 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-577dc358-3d71-47f4-a73a-d743d0bd7d8c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:43.763266 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-577dc358-3d71-47f4-a73a-d743d0bd7d8c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:43.777812 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-577dc358-3d71-47f4-a73a-d743d0bd7d8c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:43.780543 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-577dc358-3d71-47f4-a73a-d743d0bd7d8c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:43.782610 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-577dc358-3d71-47f4-a73a-d743d0bd7d8c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1735 microversion: 2.20 time: 0.263077 May 26 16:51:43.783565 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 455/904] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:43 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1735 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:43.879594 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-1ea05e9e-dd1a-4a9f-83d1-3ebb3be64197 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:43.880183 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-1ea05e9e-dd1a-4a9f-83d1-3ebb3be64197 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:43.886910 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1ea05e9e-dd1a-4a9f-83d1-3ebb3be64197 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:43.887365 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1ea05e9e-dd1a-4a9f-83d1-3ebb3be64197 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:43.888151 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1ea05e9e-dd1a-4a9f-83d1-3ebb3be64197 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:43.888700 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1ea05e9e-dd1a-4a9f-83d1-3ebb3be64197 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:44.041354 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-1ea05e9e-dd1a-4a9f-83d1-3ebb3be64197 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:44.043932 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:51:44.052279 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-1ea05e9e-dd1a-4a9f-83d1-3ebb3be64197 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1572 microversion: 2.1 time: 0.176619 May 26 16:51:44.053026 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 450/905] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:51:43 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1572 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:51:44.803398 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2c574a40-9f07-4709-930a-4cb6bb617a9f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:44.804015 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2c574a40-9f07-4709-930a-4cb6bb617a9f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:44.815415 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2c574a40-9f07-4709-930a-4cb6bb617a9f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:44.816012 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2c574a40-9f07-4709-930a-4cb6bb617a9f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:44.817054 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2c574a40-9f07-4709-930a-4cb6bb617a9f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:44.817546 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2c574a40-9f07-4709-930a-4cb6bb617a9f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:44.822311 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:51:44.969316 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-2c574a40-9f07-4709-930a-4cb6bb617a9f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:44.977720 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-2c574a40-9f07-4709-930a-4cb6bb617a9f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:44.979222 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-2c574a40-9f07-4709-930a-4cb6bb617a9f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:44.980436 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2c574a40-9f07-4709-930a-4cb6bb617a9f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1735 microversion: 2.20 time: 0.181184 May 26 16:51:44.980996 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 456/906] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:44 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:45.071446 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-a53ac4b9-2a11-43c4-bc9c-e92f19a9951b tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:45.072704 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-a53ac4b9-2a11-43c4-bc9c-e92f19a9951b tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:45.084295 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a53ac4b9-2a11-43c4-bc9c-e92f19a9951b tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:45.085594 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a53ac4b9-2a11-43c4-bc9c-e92f19a9951b tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:45.087054 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a53ac4b9-2a11-43c4-bc9c-e92f19a9951b tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:45.087852 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a53ac4b9-2a11-43c4-bc9c-e92f19a9951b tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:45.256884 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-a53ac4b9-2a11-43c4-bc9c-e92f19a9951b tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:45.274198 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-a53ac4b9-2a11-43c4-bc9c-e92f19a9951b tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1572 microversion: 2.1 time: 0.206731 May 26 16:51:45.274795 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 451/907] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:51:45 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1572 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:51:45.999675 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-5b1f96fd-73c2-4c77-8ada-6e4c01941125 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:46.000599 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-5b1f96fd-73c2-4c77-8ada-6e4c01941125 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:46.007881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5b1f96fd-73c2-4c77-8ada-6e4c01941125 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:46.008330 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5b1f96fd-73c2-4c77-8ada-6e4c01941125 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:46.009143 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5b1f96fd-73c2-4c77-8ada-6e4c01941125 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:46.009582 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5b1f96fd-73c2-4c77-8ada-6e4c01941125 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:46.161362 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-5b1f96fd-73c2-4c77-8ada-6e4c01941125 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:46.171572 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-5b1f96fd-73c2-4c77-8ada-6e4c01941125 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:46.173873 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-5b1f96fd-73c2-4c77-8ada-6e4c01941125 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:46.175234 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-5b1f96fd-73c2-4c77-8ada-6e4c01941125 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1735 microversion: 2.20 time: 0.179515 May 26 16:51:46.176320 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 457/908] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:45 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:46.294634 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-4693db38-3e54-498e-bfae-eb678e0ee8a0 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:46.295526 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-4693db38-3e54-498e-bfae-eb678e0ee8a0 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:46.302367 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4693db38-3e54-498e-bfae-eb678e0ee8a0 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:46.302822 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4693db38-3e54-498e-bfae-eb678e0ee8a0 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:46.303603 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4693db38-3e54-498e-bfae-eb678e0ee8a0 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:46.304047 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4693db38-3e54-498e-bfae-eb678e0ee8a0 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:46.459206 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-4693db38-3e54-498e-bfae-eb678e0ee8a0 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:46.467815 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-4693db38-3e54-498e-bfae-eb678e0ee8a0 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1572 microversion: 2.1 time: 0.177775 May 26 16:51:46.473110 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 452/909] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:51:46 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1572 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:51:47.196573 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-bc455f02-237d-4716-be5e-3a62225e5e8f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:47.197356 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-bc455f02-237d-4716-be5e-3a62225e5e8f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:47.206736 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bc455f02-237d-4716-be5e-3a62225e5e8f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:47.207196 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bc455f02-237d-4716-be5e-3a62225e5e8f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:47.208517 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bc455f02-237d-4716-be5e-3a62225e5e8f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:47.208941 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bc455f02-237d-4716-be5e-3a62225e5e8f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:47.360113 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-bc455f02-237d-4716-be5e-3a62225e5e8f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:47.369002 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-bc455f02-237d-4716-be5e-3a62225e5e8f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:47.371698 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-bc455f02-237d-4716-be5e-3a62225e5e8f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:47.373054 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-bc455f02-237d-4716-be5e-3a62225e5e8f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1735 microversion: 2.20 time: 0.181611 May 26 16:51:47.373857 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 458/910] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:47 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:47.489102 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-f0abfced-cf2a-4f2c-86f2-307dcde7acd7 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:47.490613 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-f0abfced-cf2a-4f2c-86f2-307dcde7acd7 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:47.498233 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f0abfced-cf2a-4f2c-86f2-307dcde7acd7 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:47.498770 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f0abfced-cf2a-4f2c-86f2-307dcde7acd7 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:47.499622 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f0abfced-cf2a-4f2c-86f2-307dcde7acd7 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:47.500143 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f0abfced-cf2a-4f2c-86f2-307dcde7acd7 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:47.647773 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-f0abfced-cf2a-4f2c-86f2-307dcde7acd7 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:47.657100 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-f0abfced-cf2a-4f2c-86f2-307dcde7acd7 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1572 microversion: 2.1 time: 0.174787 May 26 16:51:47.657703 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 453/911] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:51:47 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1572 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:51:48.393349 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2b20931b-7b7c-434b-b3d3-3d9a2a097496 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:48.394015 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2b20931b-7b7c-434b-b3d3-3d9a2a097496 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:48.406112 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2b20931b-7b7c-434b-b3d3-3d9a2a097496 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:48.406941 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2b20931b-7b7c-434b-b3d3-3d9a2a097496 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:48.408358 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2b20931b-7b7c-434b-b3d3-3d9a2a097496 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:48.409265 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2b20931b-7b7c-434b-b3d3-3d9a2a097496 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:48.570520 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-2b20931b-7b7c-434b-b3d3-3d9a2a097496 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:48.585789 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-2b20931b-7b7c-434b-b3d3-3d9a2a097496 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:48.588759 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-2b20931b-7b7c-434b-b3d3-3d9a2a097496 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:48.590310 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2b20931b-7b7c-434b-b3d3-3d9a2a097496 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1735 microversion: 2.20 time: 0.201973 May 26 16:51:48.591026 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 459/912] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:48 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1735 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:48.674788 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-35fbf452-bebd-4cb0-a8f7-92fb53a06e06 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:48.675382 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-35fbf452-bebd-4cb0-a8f7-92fb53a06e06 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:48.683695 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-35fbf452-bebd-4cb0-a8f7-92fb53a06e06 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:48.684143 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-35fbf452-bebd-4cb0-a8f7-92fb53a06e06 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:48.684967 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-35fbf452-bebd-4cb0-a8f7-92fb53a06e06 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:48.685406 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-35fbf452-bebd-4cb0-a8f7-92fb53a06e06 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:48.839521 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-35fbf452-bebd-4cb0-a8f7-92fb53a06e06 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:48.847567 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-35fbf452-bebd-4cb0-a8f7-92fb53a06e06 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1572 microversion: 2.1 time: 0.176592 May 26 16:51:48.848157 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 454/913] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:51:48 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1572 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:51:49.609635 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d1b6a9c8-0176-4d3c-8ec9-94a304b5e639 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:49.610235 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d1b6a9c8-0176-4d3c-8ec9-94a304b5e639 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:49.616925 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d1b6a9c8-0176-4d3c-8ec9-94a304b5e639 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:49.617379 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d1b6a9c8-0176-4d3c-8ec9-94a304b5e639 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:49.618172 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d1b6a9c8-0176-4d3c-8ec9-94a304b5e639 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:49.618610 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d1b6a9c8-0176-4d3c-8ec9-94a304b5e639 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:49.754039 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d1b6a9c8-0176-4d3c-8ec9-94a304b5e639 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:49.762670 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d1b6a9c8-0176-4d3c-8ec9-94a304b5e639 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:49.764185 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d1b6a9c8-0176-4d3c-8ec9-94a304b5e639 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:49.765385 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d1b6a9c8-0176-4d3c-8ec9-94a304b5e639 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1735 microversion: 2.20 time: 0.159727 May 26 16:51:49.765955 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 460/914] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:49 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:49.866851 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-8ee961ea-d940-4668-a860-1721fe457692 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:49.867417 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-8ee961ea-d940-4668-a860-1721fe457692 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:49.874638 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8ee961ea-d940-4668-a860-1721fe457692 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:49.875092 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8ee961ea-d940-4668-a860-1721fe457692 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:49.875860 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8ee961ea-d940-4668-a860-1721fe457692 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:49.876305 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8ee961ea-d940-4668-a860-1721fe457692 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:50.015714 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-8ee961ea-d940-4668-a860-1721fe457692 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:50.023446 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-8ee961ea-d940-4668-a860-1721fe457692 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1572 microversion: 2.1 time: 0.160548 May 26 16:51:50.024037 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 455/915] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:51:49 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1572 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:51:50.783504 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0da1e809-428c-4492-a06a-df2b195467cf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:50.784110 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0da1e809-428c-4492-a06a-df2b195467cf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:50.790803 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0da1e809-428c-4492-a06a-df2b195467cf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:50.791253 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0da1e809-428c-4492-a06a-df2b195467cf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:50.792107 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0da1e809-428c-4492-a06a-df2b195467cf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:50.792580 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0da1e809-428c-4492-a06a-df2b195467cf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:50.925827 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0da1e809-428c-4492-a06a-df2b195467cf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:50.933786 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0da1e809-428c-4492-a06a-df2b195467cf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:50.935285 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0da1e809-428c-4492-a06a-df2b195467cf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:50.936468 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0da1e809-428c-4492-a06a-df2b195467cf tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1735 microversion: 2.20 time: 0.156923 May 26 16:51:50.937031 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 461/916] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:50 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:51.040606 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-9759d673-21a6-413b-9407-5dd5038d1ecd tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:51.041158 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-9759d673-21a6-413b-9407-5dd5038d1ecd tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:51.047609 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9759d673-21a6-413b-9407-5dd5038d1ecd tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:51.048055 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9759d673-21a6-413b-9407-5dd5038d1ecd tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:51.048847 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9759d673-21a6-413b-9407-5dd5038d1ecd tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:51.049283 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9759d673-21a6-413b-9407-5dd5038d1ecd tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:51.177867 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-9759d673-21a6-413b-9407-5dd5038d1ecd tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:51.186160 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-9759d673-21a6-413b-9407-5dd5038d1ecd tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1572 microversion: 2.1 time: 0.149548 May 26 16:51:51.186739 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 456/917] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:51:51 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1572 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:51:51.955339 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f620f7ee-8ea8-4fa3-8b0a-335340ec7da9 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:51.956030 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f620f7ee-8ea8-4fa3-8b0a-335340ec7da9 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:51.958399 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:51:51.964468 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f620f7ee-8ea8-4fa3-8b0a-335340ec7da9 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:51.964921 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f620f7ee-8ea8-4fa3-8b0a-335340ec7da9 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:51.965707 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f620f7ee-8ea8-4fa3-8b0a-335340ec7da9 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:51.966147 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f620f7ee-8ea8-4fa3-8b0a-335340ec7da9 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:52.113884 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f620f7ee-8ea8-4fa3-8b0a-335340ec7da9 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:52.122004 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f620f7ee-8ea8-4fa3-8b0a-335340ec7da9 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:52.123497 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f620f7ee-8ea8-4fa3-8b0a-335340ec7da9 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:52.124681 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f620f7ee-8ea8-4fa3-8b0a-335340ec7da9 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1735 microversion: 2.20 time: 0.173453 May 26 16:51:52.125457 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 462/918] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:51 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:52.203068 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-898769ff-aea5-4b19-bb2f-d43d443f36c5 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:52.203662 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-898769ff-aea5-4b19-bb2f-d43d443f36c5 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:52.210522 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-898769ff-aea5-4b19-bb2f-d43d443f36c5 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:52.210933 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-898769ff-aea5-4b19-bb2f-d43d443f36c5 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:52.211721 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-898769ff-aea5-4b19-bb2f-d43d443f36c5 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:52.212162 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-898769ff-aea5-4b19-bb2f-d43d443f36c5 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:52.348482 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-898769ff-aea5-4b19-bb2f-d43d443f36c5 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:52.356220 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-898769ff-aea5-4b19-bb2f-d43d443f36c5 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1572 microversion: 2.1 time: 0.157068 May 26 16:51:52.356822 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 457/919] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:51:52 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1572 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:51:53.142910 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-59e9b8ae-aa1f-46ac-8bdf-f1b2389a1435 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:53.143548 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-59e9b8ae-aa1f-46ac-8bdf-f1b2389a1435 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:53.150271 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-59e9b8ae-aa1f-46ac-8bdf-f1b2389a1435 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:53.150718 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-59e9b8ae-aa1f-46ac-8bdf-f1b2389a1435 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:53.151501 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-59e9b8ae-aa1f-46ac-8bdf-f1b2389a1435 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:53.151935 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-59e9b8ae-aa1f-46ac-8bdf-f1b2389a1435 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:53.316137 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-59e9b8ae-aa1f-46ac-8bdf-f1b2389a1435 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:53.324209 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-59e9b8ae-aa1f-46ac-8bdf-f1b2389a1435 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:53.326044 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-59e9b8ae-aa1f-46ac-8bdf-f1b2389a1435 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:53.327214 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-59e9b8ae-aa1f-46ac-8bdf-f1b2389a1435 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1735 microversion: 2.20 time: 0.188334 May 26 16:51:53.327769 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 463/920] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:53 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1735 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:53.373978 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-9dadd98d-3eef-44e2-8059-bc7150e0feaa tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:53.374575 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-9dadd98d-3eef-44e2-8059-bc7150e0feaa tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:53.376947 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_api:SELECT=44 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:51:53.382917 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9dadd98d-3eef-44e2-8059-bc7150e0feaa tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:53.383359 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9dadd98d-3eef-44e2-8059-bc7150e0feaa tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:53.384131 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9dadd98d-3eef-44e2-8059-bc7150e0feaa tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:53.384594 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9dadd98d-3eef-44e2-8059-bc7150e0feaa tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:53.532093 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-9dadd98d-3eef-44e2-8059-bc7150e0feaa tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:53.540168 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-9dadd98d-3eef-44e2-8059-bc7150e0feaa tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1572 microversion: 2.1 time: 0.170727 May 26 16:51:53.540782 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 458/921] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:51:53 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1572 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:51:54.346258 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a15a4879-a391-4532-be19-e7d9572ad69e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:54.346860 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a15a4879-a391-4532-be19-e7d9572ad69e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:54.353518 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a15a4879-a391-4532-be19-e7d9572ad69e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:54.353973 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a15a4879-a391-4532-be19-e7d9572ad69e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:54.354757 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a15a4879-a391-4532-be19-e7d9572ad69e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:54.355196 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a15a4879-a391-4532-be19-e7d9572ad69e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:54.486126 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a15a4879-a391-4532-be19-e7d9572ad69e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:54.494111 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a15a4879-a391-4532-be19-e7d9572ad69e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:54.495653 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a15a4879-a391-4532-be19-e7d9572ad69e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:54.496849 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a15a4879-a391-4532-be19-e7d9572ad69e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1735 microversion: 2.20 time: 0.154555 May 26 16:51:54.497419 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 464/922] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:54 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:54.566730 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-03dc67a4-0b02-4840-b599-a388c2cdd956 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:54.567310 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-03dc67a4-0b02-4840-b599-a388c2cdd956 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:54.574490 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-03dc67a4-0b02-4840-b599-a388c2cdd956 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:54.574947 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-03dc67a4-0b02-4840-b599-a388c2cdd956 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:54.575726 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-03dc67a4-0b02-4840-b599-a388c2cdd956 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:54.576166 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-03dc67a4-0b02-4840-b599-a388c2cdd956 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:54.712133 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-03dc67a4-0b02-4840-b599-a388c2cdd956 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:54.720493 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-03dc67a4-0b02-4840-b599-a388c2cdd956 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1572 microversion: 2.1 time: 0.158026 May 26 16:51:54.721189 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 459/923] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:51:54 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1572 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:51:55.515547 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-b00bcb14-b2c6-46ba-b398-9e935ca1804a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:55.516181 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-b00bcb14-b2c6-46ba-b398-9e935ca1804a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:55.522822 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b00bcb14-b2c6-46ba-b398-9e935ca1804a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:55.523278 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b00bcb14-b2c6-46ba-b398-9e935ca1804a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:55.524049 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b00bcb14-b2c6-46ba-b398-9e935ca1804a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:55.524515 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b00bcb14-b2c6-46ba-b398-9e935ca1804a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:55.658675 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b00bcb14-b2c6-46ba-b398-9e935ca1804a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:55.670811 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b00bcb14-b2c6-46ba-b398-9e935ca1804a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:55.672475 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b00bcb14-b2c6-46ba-b398-9e935ca1804a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:55.673667 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-b00bcb14-b2c6-46ba-b398-9e935ca1804a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1735 microversion: 2.20 time: 0.162164 May 26 16:51:55.674233 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 465/924] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:55 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:51:55.738092 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-a7e08726-5a94-4d0f-a5dd-7cc51e164db4 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:55.738735 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-a7e08726-5a94-4d0f-a5dd-7cc51e164db4 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:55.745289 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a7e08726-5a94-4d0f-a5dd-7cc51e164db4 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:55.745749 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a7e08726-5a94-4d0f-a5dd-7cc51e164db4 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:55.746519 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a7e08726-5a94-4d0f-a5dd-7cc51e164db4 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:55.746953 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a7e08726-5a94-4d0f-a5dd-7cc51e164db4 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:55.880688 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-a7e08726-5a94-4d0f-a5dd-7cc51e164db4 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:55.888348 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-a7e08726-5a94-4d0f-a5dd-7cc51e164db4 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1572 microversion: 2.1 time: 0.154149 May 26 16:51:55.888943 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 460/925] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:51:55 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1572 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:51:56.693491 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a3eeaaf1-7f26-4635-931f-3b4490248248 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:56.694094 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a3eeaaf1-7f26-4635-931f-3b4490248248 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:56.700932 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a3eeaaf1-7f26-4635-931f-3b4490248248 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:56.701377 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a3eeaaf1-7f26-4635-931f-3b4490248248 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:56.702142 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a3eeaaf1-7f26-4635-931f-3b4490248248 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:56.702572 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a3eeaaf1-7f26-4635-931f-3b4490248248 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:56.842898 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a3eeaaf1-7f26-4635-931f-3b4490248248 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:56.851373 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a3eeaaf1-7f26-4635-931f-3b4490248248 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:56.852863 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a3eeaaf1-7f26-4635-931f-3b4490248248 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:56.854067 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a3eeaaf1-7f26-4635-931f-3b4490248248 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1735 microversion: 2.20 time: 0.164696 May 26 16:51:56.854632 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 466/926] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:56 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:51:56.906137 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-06a54227-f4e9-4783-a410-0252cf777c3b tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:56.906750 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-06a54227-f4e9-4783-a410-0252cf777c3b tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:56.913702 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-06a54227-f4e9-4783-a410-0252cf777c3b tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:56.914150 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-06a54227-f4e9-4783-a410-0252cf777c3b tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:56.914986 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-06a54227-f4e9-4783-a410-0252cf777c3b tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:56.915426 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-06a54227-f4e9-4783-a410-0252cf777c3b tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:57.098408 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-06a54227-f4e9-4783-a410-0252cf777c3b tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:57.107986 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-06a54227-f4e9-4783-a410-0252cf777c3b tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1572 microversion: 2.1 time: 0.205427 May 26 16:51:57.108778 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 461/927] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:51:56 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1572 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:51:57.582185 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-8d755b27-55b2-4a7c-bae8-b437e2fa34e6 req-8b010b57-c2c9-4ca3-8e25-1a57f2145aab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "898074a4-2c24-403a-bdd9-e9809f6375fd", "name": "network-vif-deleted", "tag": "a5a3472f-1b24-4c5b-ada9-48c5e198da12"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:51:57.592767 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-8d755b27-55b2-4a7c-bae8-b437e2fa34e6 req-8b010b57-c2c9-4ca3-8e25-1a57f2145aab service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:57.593215 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-8d755b27-55b2-4a7c-bae8-b437e2fa34e6 req-8b010b57-c2c9-4ca3-8e25-1a57f2145aab service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:57.606932 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-8d755b27-55b2-4a7c-bae8-b437e2fa34e6 req-8b010b57-c2c9-4ca3-8e25-1a57f2145aab service nova] Creating event network-vif-deleted:a5a3472f-1b24-4c5b-ada9-48c5e198da12 for instance 898074a4-2c24-403a-bdd9-e9809f6375fd on hv-cinder-83607 May 26 16:51:57.612729 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-8d755b27-55b2-4a7c-bae8-b437e2fa34e6 req-8b010b57-c2c9-4ca3-8e25-1a57f2145aab service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034504 May 26 16:51:57.613697 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 467/928] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:51:57.873112 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-47ed74d1-6f3f-4b4e-b0df-ff52a7e24b9f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:57.873731 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-47ed74d1-6f3f-4b4e-b0df-ff52a7e24b9f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:57.880076 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-47ed74d1-6f3f-4b4e-b0df-ff52a7e24b9f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:57.880567 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-47ed74d1-6f3f-4b4e-b0df-ff52a7e24b9f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:57.881409 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-47ed74d1-6f3f-4b4e-b0df-ff52a7e24b9f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:57.881774 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-47ed74d1-6f3f-4b4e-b0df-ff52a7e24b9f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:58.066376 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-47ed74d1-6f3f-4b4e-b0df-ff52a7e24b9f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:58.079951 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-47ed74d1-6f3f-4b4e-b0df-ff52a7e24b9f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:58.082571 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-47ed74d1-6f3f-4b4e-b0df-ff52a7e24b9f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:58.083838 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-47ed74d1-6f3f-4b4e-b0df-ff52a7e24b9f tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1735 microversion: 2.20 time: 0.215463 May 26 16:51:58.084429 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 462/929] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:57 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1735 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:58.125958 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7e40ea39-57e1-4913-a384-ab1dfaab5a33 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:58.126638 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-7e40ea39-57e1-4913-a384-ab1dfaab5a33 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:58.133537 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7e40ea39-57e1-4913-a384-ab1dfaab5a33 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:58.134029 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7e40ea39-57e1-4913-a384-ab1dfaab5a33 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:58.134842 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7e40ea39-57e1-4913-a384-ab1dfaab5a33 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:58.135287 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7e40ea39-57e1-4913-a384-ab1dfaab5a33 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:58.168030 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7e40ea39-57e1-4913-a384-ab1dfaab5a33 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:58.168487 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7e40ea39-57e1-4913-a384-ab1dfaab5a33 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:58.168943 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.objects.instance [None req-7e40ea39-57e1-4913-a384-ab1dfaab5a33 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lazy-loading 'fault' on Instance uuid 898074a4-2c24-403a-bdd9-e9809f6375fd {{(pid=124266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:51:58.214726 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7e40ea39-57e1-4913-a384-ab1dfaab5a33 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f7cb90a5d74658ac55943d37d28737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffc538830947bbbfd272fb857cbc03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:58.222467 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7e40ea39-57e1-4913-a384-ab1dfaab5a33 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 200 len: 1228 microversion: 2.1 time: 0.101227 May 26 16:51:58.223043 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 468/930] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:51:58 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 1228 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:51:59.102655 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-f151d1cd-1a16-4187-a623-99b37c9e57b5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:59.103298 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-f151d1cd-1a16-4187-a623-99b37c9e57b5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:59.109954 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f151d1cd-1a16-4187-a623-99b37c9e57b5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:59.110409 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f151d1cd-1a16-4187-a623-99b37c9e57b5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:59.111202 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f151d1cd-1a16-4187-a623-99b37c9e57b5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:59.111643 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f151d1cd-1a16-4187-a623-99b37c9e57b5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:59.240272 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-afb046db-aab5-4dc0-b902-24fc5603a80e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:59.241480 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-afb046db-aab5-4dc0-b902-24fc5603a80e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] [instance: 898074a4-2c24-403a-bdd9-e9809f6375fd] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:51:59.242766 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-f151d1cd-1a16-4187-a623-99b37c9e57b5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:59.248617 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-afb046db-aab5-4dc0-b902-24fc5603a80e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:59.249520 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-afb046db-aab5-4dc0-b902-24fc5603a80e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:59.250190 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-afb046db-aab5-4dc0-b902-24fc5603a80e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:59.250779 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-afb046db-aab5-4dc0-b902-24fc5603a80e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:59.251607 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-f151d1cd-1a16-4187-a623-99b37c9e57b5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:59.253259 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-f151d1cd-1a16-4187-a623-99b37c9e57b5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:51:59.254515 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-f151d1cd-1a16-4187-a623-99b37c9e57b5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1735 microversion: 2.20 time: 0.155776 May 26 16:51:59.255154 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 463/931] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:51:59 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:59.272145 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-afb046db-aab5-4dc0-b902-24fc5603a80e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] HTTP exception thrown: Instance 898074a4-2c24-403a-bdd9-e9809f6375fd could not be found. May 26 16:51:59.273848 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-afb046db-aab5-4dc0-b902-24fc5603a80e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Request method failure captured: May 26 16:51:59.273848 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd HTTP/1.1 May 26 16:51:59.273848 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept: application/json May 26 16:51:59.273848 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity May 26 16:51:59.273848 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Connection: close May 26 16:51:59.273848 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Length: 0 May 26 16:51:59.273848 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Type: application/json May 26 16:51:59.273848 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Host: 10.222.0.102 May 26 16:51:59.273848 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None May 26 16:51:59.273848 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 May 26 16:51:59.273848 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABij6544mDiUEeFHNKgZOOis6Ccc8Uho32kUrsnYYNIsyX7T_0zqmCv3QnPxqakQOuIwOlc-fo4o3C2mVG5Ja8LmFs6HQ6tMvFcBPFeRaOK1nll-3G0qDr6_wWws17EA6RkVqC-P-ZWXkNAC5LptodNM2aoZAh84oeeEM1qQyyb8nEy8R0 May 26 16:51:59.273848 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Id: None May 26 16:51:59.273848 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Name: None May 26 16:51:59.273848 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed May 26 16:51:59.273848 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True May 26 16:51:59.273848 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default May 26 16:51:59.273848 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default May 26 16:51:59.273848 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Id: a5ffc538830947bbbfd272fb857cbc03 May 26 16:51:59.273848 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-TestShelveInstance-1339508411 May 26 16:51:59.273848 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Role: reader,member May 26 16:51:59.273848 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Roles: reader,member May 26 16:51:59.276293 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/a5ffc538830947bbbfd272fb857cbc03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/a5ffc538830947bbbfd272fb857cbc03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/a5ffc538830947bbbfd272fb857cbc03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_a5ffc538830947bbbfd272fb857cbc03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:51:59.276293 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-TestShelveInstance-1339508411 May 26 16:51:59.276293 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Id: a5ffc538830947bbbfd272fb857cbc03 May 26 16:51:59.276293 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-TestShelveInstance-1339508411 May 26 16:51:59.276293 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User: tempest-TestShelveInstance-1339508411-project May 26 16:51:59.276293 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default May 26 16:51:59.276293 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default May 26 16:51:59.276293 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Id: c2f7cb90a5d74658ac55943d37d28737 May 26 16:51:59.276293 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-TestShelveInstance-1339508411-project May 26 16:51:59.276293 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: method: > May 26 16:51:59.276293 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: exception: Instance 898074a4-2c24-403a-bdd9-e9809f6375fd could not be found. May 26 16:51:59.276293 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: action_args: {'id': '898074a4-2c24-403a-bdd9-e9809f6375fd'} May 26 16:51:59.277304 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:51:59.277304 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:51:59.277304 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:51:59.277304 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:51:59.277304 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:51:59.277304 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:51:59.277304 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:51:59.277304 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:51:59.277304 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:51:59.277304 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:51:59.277304 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 898074a4-2c24-403a-bdd9-e9809f6375fd could not be found. May 26 16:51:59.277304 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:51:59.277304 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:51:59.277304 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:51:59.277304 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:51:59.277304 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:51:59.277304 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:51:59.277304 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:51:59.277304 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:51:59.277304 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:51:59.278881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:51:59.278881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 16:51:59.278881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 16:51:59.278881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:51:59.278881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:51:59.278881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:51:59.278881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:51:59.278881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 898074a4-2c24-403a-bdd9-e9809f6375fd could not be found. May 26 16:51:59.278881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:51:59.278881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:51:59.278881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:51:59.278881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:51:59.278881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:51:59.278881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:51:59.278881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:51:59.278881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:51:59.278881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 898074a4-2c24-403a-bdd9-e9809f6375fd could not be found. May 26 16:51:59.278881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:51:59.280402 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-afb046db-aab5-4dc0-b902-24fc5603a80e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Returning 404 to user: Instance 898074a4-2c24-403a-bdd9-e9809f6375fd could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:51:59.280402 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-afb046db-aab5-4dc0-b902-24fc5603a80e tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd" status: 404 len: 111 microversion: 2.1 time: 0.038995 May 26 16:51:59.280402 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 469/932] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:51:59 2022] GET /compute/v2.1/servers/898074a4-2c24-403a-bdd9-e9809f6375fd => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 16:51:59.440287 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-a3495a5e-66be-4a09-95c1-22dd082a77e5 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] Calling method '.version_select at 0x7f93a3dcfdc0>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:59.461119 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-a3495a5e-66be-4a09-95c1-22dd082a77e5 tempest-TestShelveInstance-1339508411 tempest-TestShelveInstance-1339508411-project] 10.222.0.102 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1311331693" status: 202 len: 0 microversion: 2.1 time: 0.024628 May 26 16:51:59.461728 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 464/933] 10.222.0.102 () {58 vars in 1258 bytes} [Thu May 26 16:51:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1311331693 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 16:52:00.273554 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6a56e6a8-9af2-4163-a2f1-9720fd9825bb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:52:00.274151 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-6a56e6a8-9af2-4163-a2f1-9720fd9825bb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:52:00.281491 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6a56e6a8-9af2-4163-a2f1-9720fd9825bb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:00.282014 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6a56e6a8-9af2-4163-a2f1-9720fd9825bb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:00.282874 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6a56e6a8-9af2-4163-a2f1-9720fd9825bb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:00.283323 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6a56e6a8-9af2-4163-a2f1-9720fd9825bb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:00.432346 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6a56e6a8-9af2-4163-a2f1-9720fd9825bb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:52:00.441575 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6a56e6a8-9af2-4163-a2f1-9720fd9825bb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:52:00.443213 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6a56e6a8-9af2-4163-a2f1-9720fd9825bb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:52:00.444723 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6a56e6a8-9af2-4163-a2f1-9720fd9825bb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1735 microversion: 2.20 time: 0.175164 May 26 16:52:00.455313 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 470/934] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:52:00 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:52:00.617679 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-c9196f5a-68b1-4b18-866e-8447892ef851 req-fa256a67-bc6d-4b8a-9552-54030a407c05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead585f3-8422-41d8-9a7e-babd902216ea", "name": "network-vif-plugged", "status": "completed", "tag": "cc45ab72-d2ad-4d48-a593-2e836c66dcb4"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:52:00.630354 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-c9196f5a-68b1-4b18-866e-8447892ef851 req-fa256a67-bc6d-4b8a-9552-54030a407c05 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:00.630801 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-c9196f5a-68b1-4b18-866e-8447892ef851 req-fa256a67-bc6d-4b8a-9552-54030a407c05 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:00.641981 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-c9196f5a-68b1-4b18-866e-8447892ef851 req-fa256a67-bc6d-4b8a-9552-54030a407c05 service nova] Creating event network-vif-plugged:cc45ab72-d2ad-4d48-a593-2e836c66dcb4 for instance ead585f3-8422-41d8-9a7e-babd902216ea on hv-cinder-83607 May 26 16:52:00.647098 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-c9196f5a-68b1-4b18-866e-8447892ef851 req-fa256a67-bc6d-4b8a-9552-54030a407c05 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175399 May 26 16:52:00.647687 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 465/935] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:52:01.462934 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-c2717101-2a22-45ce-96e9-5d43782f075e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:52:01.463757 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-c2717101-2a22-45ce-96e9-5d43782f075e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:52:01.470253 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c2717101-2a22-45ce-96e9-5d43782f075e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:01.470783 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c2717101-2a22-45ce-96e9-5d43782f075e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:01.471742 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c2717101-2a22-45ce-96e9-5d43782f075e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:01.472482 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c2717101-2a22-45ce-96e9-5d43782f075e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:01.613414 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c2717101-2a22-45ce-96e9-5d43782f075e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:52:01.636533 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c2717101-2a22-45ce-96e9-5d43782f075e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:52:01.642359 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c2717101-2a22-45ce-96e9-5d43782f075e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:52:01.644234 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-c2717101-2a22-45ce-96e9-5d43782f075e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1735 microversion: 2.20 time: 0.185291 May 26 16:52:01.644935 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 471/936] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:52:01 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:52:02.664092 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-f6772fbe-491f-4ebe-807c-4d3c6869f92c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:52:02.664825 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-f6772fbe-491f-4ebe-807c-4d3c6869f92c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:52:02.706082 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f6772fbe-491f-4ebe-807c-4d3c6869f92c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:02.706629 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f6772fbe-491f-4ebe-807c-4d3c6869f92c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:02.707675 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f6772fbe-491f-4ebe-807c-4d3c6869f92c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:02.707903 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f6772fbe-491f-4ebe-807c-4d3c6869f92c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:02.937349 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-f6772fbe-491f-4ebe-807c-4d3c6869f92c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:52:02.945943 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-f6772fbe-491f-4ebe-807c-4d3c6869f92c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:52:02.948680 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-f6772fbe-491f-4ebe-807c-4d3c6869f92c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:52:02.952094 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-f6772fbe-491f-4ebe-807c-4d3c6869f92c tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1735 microversion: 2.20 time: 0.292390 May 26 16:52:02.953032 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 466/937] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:52:02 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1735 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:52:03.972180 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8d814f76-c9d3-40c1-91f0-a289eda1f994 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:52:03.972842 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-8d814f76-c9d3-40c1-91f0-a289eda1f994 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:52:03.982190 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8d814f76-c9d3-40c1-91f0-a289eda1f994 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:03.982650 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8d814f76-c9d3-40c1-91f0-a289eda1f994 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:03.983446 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8d814f76-c9d3-40c1-91f0-a289eda1f994 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:03.983897 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8d814f76-c9d3-40c1-91f0-a289eda1f994 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:04.122916 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8d814f76-c9d3-40c1-91f0-a289eda1f994 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:52:04.131675 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8d814f76-c9d3-40c1-91f0-a289eda1f994 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:52:04.133176 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-8d814f76-c9d3-40c1-91f0-a289eda1f994 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:52:04.134382 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-8d814f76-c9d3-40c1-91f0-a289eda1f994 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1722 microversion: 2.20 time: 0.166568 May 26 16:52:04.134989 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 472/938] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:52:03 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:52:08.231397 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-f7e02f8c-b870-40de-a284-5a9ffac0e74a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:52:08.231972 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-f7e02f8c-b870-40de-a284-5a9ffac0e74a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 1d458ca8-f76c-432f-84ff-ab64b839c49d] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:52:08.238773 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f7e02f8c-b870-40de-a284-5a9ffac0e74a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:08.239164 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f7e02f8c-b870-40de-a284-5a9ffac0e74a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:08.239935 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f7e02f8c-b870-40de-a284-5a9ffac0e74a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:08.240393 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f7e02f8c-b870-40de-a284-5a9ffac0e74a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:08.263683 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-f7e02f8c-b870-40de-a284-5a9ffac0e74a tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d/ips" status: 200 len: 146 microversion: 2.1 time: 0.036732 May 26 16:52:08.264243 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 467/939] 10.222.0.102 () {58 vars in 1252 bytes} [Thu May 26 16:52:08 2022] GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:52:09.579737 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0903fd6a-d1d3-49ed-ba6d-37b0fe6c5d18 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b3d07496-7aa9-4e1a-90b5-72272d6ef339"}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:52:09.580998 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0903fd6a-d1d3-49ed-ba6d-37b0fe6c5d18 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 1d458ca8-f76c-432f-84ff-ab64b839c49d] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:52:09.587673 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0903fd6a-d1d3-49ed-ba6d-37b0fe6c5d18 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:09.588205 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0903fd6a-d1d3-49ed-ba6d-37b0fe6c5d18 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:09.588996 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0903fd6a-d1d3-49ed-ba6d-37b0fe6c5d18 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:09.589431 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0903fd6a-d1d3-49ed-ba6d-37b0fe6c5d18 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:09.663242 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=100 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:52:09.863380 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0903fd6a-d1d3-49ed-ba6d-37b0fe6c5d18 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "POST /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287563 May 26 16:52:09.863995 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 473/940] 10.222.0.102 () {60 vars in 1327 bytes} [Thu May 26 16:52:09 2022] POST /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:52:17.377181 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-8efef4a3-cda0-41cf-8e32-7f5147071344 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:52:17.378045 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-8efef4a3-cda0-41cf-8e32-7f5147071344 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 1d458ca8-f76c-432f-84ff-ab64b839c49d] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:52:17.384028 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8efef4a3-cda0-41cf-8e32-7f5147071344 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:17.384537 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8efef4a3-cda0-41cf-8e32-7f5147071344 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:17.385300 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8efef4a3-cda0-41cf-8e32-7f5147071344 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:17.385738 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8efef4a3-cda0-41cf-8e32-7f5147071344 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:17.388169 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=92 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:52:17.416436 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-8efef4a3-cda0-41cf-8e32-7f5147071344 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042705 May 26 16:52:17.416993 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 468/941] 10.222.0.102 () {58 vars in 1306 bytes} [Thu May 26 16:52:17 2022] GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:52:17.427975 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-5e61d21f-0dc9-40a7-91e1-be27bcd215b1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:52:17.428590 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-5e61d21f-0dc9-40a7-91e1-be27bcd215b1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 1d458ca8-f76c-432f-84ff-ab64b839c49d] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:52:17.434876 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5e61d21f-0dc9-40a7-91e1-be27bcd215b1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:17.435334 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5e61d21f-0dc9-40a7-91e1-be27bcd215b1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:17.436099 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5e61d21f-0dc9-40a7-91e1-be27bcd215b1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:17.436566 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5e61d21f-0dc9-40a7-91e1-be27bcd215b1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:17.466136 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-5e61d21f-0dc9-40a7-91e1-be27bcd215b1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d/os-volume_attachments/b3d07496-7aa9-4e1a-90b5-72272d6ef339" status: 200 len: 194 microversion: 2.1 time: 0.043022 May 26 16:52:17.466814 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 474/942] 10.222.0.102 () {58 vars in 1417 bytes} [Thu May 26 16:52:17 2022] GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d/os-volume_attachments/b3d07496-7aa9-4e1a-90b5-72272d6ef339 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:52:18.785266 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-e891bca6-b2d0-4455-b74c-64ba1f6cd3fd tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c023157-3395-4b8e-bfcd-4395ca14fe91"}} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:52:18.786330 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-e891bca6-b2d0-4455-b74c-64ba1f6cd3fd tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 1d458ca8-f76c-432f-84ff-ab64b839c49d] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:52:18.792982 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e891bca6-b2d0-4455-b74c-64ba1f6cd3fd tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:18.793434 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e891bca6-b2d0-4455-b74c-64ba1f6cd3fd tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:18.794314 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e891bca6-b2d0-4455-b74c-64ba1f6cd3fd tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:18.794643 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e891bca6-b2d0-4455-b74c-64ba1f6cd3fd tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:19.049194 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-e891bca6-b2d0-4455-b74c-64ba1f6cd3fd tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "POST /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267670 May 26 16:52:19.051234 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 469/943] 10.222.0.102 () {60 vars in 1327 bytes} [Thu May 26 16:52:18 2022] POST /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:52:26.533125 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-914d8b14-b287-4bd7-83fe-74e79b2341ea tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:52:26.534157 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-914d8b14-b287-4bd7-83fe-74e79b2341ea tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 1d458ca8-f76c-432f-84ff-ab64b839c49d] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:52:26.536688 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=28 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:52:26.543149 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-914d8b14-b287-4bd7-83fe-74e79b2341ea tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:26.543542 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-914d8b14-b287-4bd7-83fe-74e79b2341ea tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:26.544307 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-914d8b14-b287-4bd7-83fe-74e79b2341ea tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:26.544764 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-914d8b14-b287-4bd7-83fe-74e79b2341ea tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:26.573586 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-914d8b14-b287-4bd7-83fe-74e79b2341ea tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044298 May 26 16:52:26.574147 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 475/944] 10.222.0.102 () {58 vars in 1306 bytes} [Thu May 26 16:52:26 2022] GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:52:26.716347 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-82966432-d3f4-4973-b2a9-c22aeed665d2 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:52:26.717094 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-82966432-d3f4-4973-b2a9-c22aeed665d2 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 1d458ca8-f76c-432f-84ff-ab64b839c49d] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:52:26.719031 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:52:26.724708 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-82966432-d3f4-4973-b2a9-c22aeed665d2 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:26.725165 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-82966432-d3f4-4973-b2a9-c22aeed665d2 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:26.725937 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-82966432-d3f4-4973-b2a9-c22aeed665d2 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:26.726376 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-82966432-d3f4-4973-b2a9-c22aeed665d2 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:26.755528 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-82966432-d3f4-4973-b2a9-c22aeed665d2 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d/os-volume_attachments/b3d07496-7aa9-4e1a-90b5-72272d6ef339" status: 200 len: 194 microversion: 2.1 time: 0.044578 May 26 16:52:26.756102 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 470/945] 10.222.0.102 () {58 vars in 1417 bytes} [Thu May 26 16:52:26 2022] GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d/os-volume_attachments/b3d07496-7aa9-4e1a-90b5-72272d6ef339 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:52:26.766157 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-22ffa716-eb76-4ff9-b94f-a939d44f64ac tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:52:26.766656 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-22ffa716-eb76-4ff9-b94f-a939d44f64ac tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 1d458ca8-f76c-432f-84ff-ab64b839c49d] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:52:26.772580 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-22ffa716-eb76-4ff9-b94f-a939d44f64ac tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:26.773029 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-22ffa716-eb76-4ff9-b94f-a939d44f64ac tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:26.773790 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-22ffa716-eb76-4ff9-b94f-a939d44f64ac tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:26.774228 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-22ffa716-eb76-4ff9-b94f-a939d44f64ac tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:26.855113 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.objects.instance [None req-22ffa716-eb76-4ff9-b94f-a939d44f64ac tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lazy-loading 'services' on Instance uuid 1d458ca8-f76c-432f-84ff-ab64b839c49d {{(pid=124266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:52:26.969914 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-22ffa716-eb76-4ff9-b94f-a939d44f64ac tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "DELETE /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d/os-volume_attachments/b3d07496-7aa9-4e1a-90b5-72272d6ef339" status: 202 len: 0 microversion: 2.1 time: 0.207438 May 26 16:52:26.970527 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 476/946] 10.222.0.102 () {58 vars in 1420 bytes} [Thu May 26 16:52:26 2022] DELETE /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d/os-volume_attachments/b3d07496-7aa9-4e1a-90b5-72272d6ef339 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 16:52:29.136517 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-3ad68414-7228-46a7-8f72-8b161f904c15 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:52:29.137045 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-3ad68414-7228-46a7-8f72-8b161f904c15 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 1d458ca8-f76c-432f-84ff-ab64b839c49d] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:52:29.143618 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3ad68414-7228-46a7-8f72-8b161f904c15 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:29.144060 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3ad68414-7228-46a7-8f72-8b161f904c15 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:29.144858 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3ad68414-7228-46a7-8f72-8b161f904c15 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:29.145300 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3ad68414-7228-46a7-8f72-8b161f904c15 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:29.174172 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-3ad68414-7228-46a7-8f72-8b161f904c15 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d/os-volume_attachments/6c023157-3395-4b8e-bfcd-4395ca14fe91" status: 200 len: 194 microversion: 2.1 time: 0.042158 May 26 16:52:29.174743 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 471/947] 10.222.0.102 () {58 vars in 1417 bytes} [Thu May 26 16:52:29 2022] GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d/os-volume_attachments/6c023157-3395-4b8e-bfcd-4395ca14fe91 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:52:29.185023 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-799ebf63-73ae-4b2f-b30b-4fcd1824c6c1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:52:29.185605 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-799ebf63-73ae-4b2f-b30b-4fcd1824c6c1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 1d458ca8-f76c-432f-84ff-ab64b839c49d] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:52:29.192418 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-799ebf63-73ae-4b2f-b30b-4fcd1824c6c1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:29.192865 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-799ebf63-73ae-4b2f-b30b-4fcd1824c6c1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:29.193617 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-799ebf63-73ae-4b2f-b30b-4fcd1824c6c1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:29.194049 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-799ebf63-73ae-4b2f-b30b-4fcd1824c6c1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:29.281758 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.objects.instance [None req-799ebf63-73ae-4b2f-b30b-4fcd1824c6c1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lazy-loading 'services' on Instance uuid 1d458ca8-f76c-432f-84ff-ab64b839c49d {{(pid=124266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:52:29.352987 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-799ebf63-73ae-4b2f-b30b-4fcd1824c6c1 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "DELETE /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d/os-volume_attachments/6c023157-3395-4b8e-bfcd-4395ca14fe91" status: 202 len: 0 microversion: 2.1 time: 0.171921 May 26 16:52:29.353599 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 477/948] 10.222.0.102 () {58 vars in 1420 bytes} [Thu May 26 16:52:29 2022] DELETE /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d/os-volume_attachments/6c023157-3395-4b8e-bfcd-4395ca14fe91 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 16:52:30.516550 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-3d87500d-8b68-4df5-a8bc-bb6c5d8e85ca tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:52:30.517565 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-3d87500d-8b68-4df5-a8bc-bb6c5d8e85ca tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 1d458ca8-f76c-432f-84ff-ab64b839c49d] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:52:30.524028 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3d87500d-8b68-4df5-a8bc-bb6c5d8e85ca tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:30.525097 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3d87500d-8b68-4df5-a8bc-bb6c5d8e85ca tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:30.525939 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3d87500d-8b68-4df5-a8bc-bb6c5d8e85ca tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:30.526381 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3d87500d-8b68-4df5-a8bc-bb6c5d8e85ca tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:30.555228 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-3d87500d-8b68-4df5-a8bc-bb6c5d8e85ca tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042705 May 26 16:52:30.555825 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 472/949] 10.222.0.102 () {58 vars in 1306 bytes} [Thu May 26 16:52:30 2022] GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 16:52:30.668677 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7a7a5610-63c3-4a2b-b72a-8e4e9519a81e tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:52:30.669728 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-7a7a5610-63c3-4a2b-b72a-8e4e9519a81e tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 1d458ca8-f76c-432f-84ff-ab64b839c49d] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:52:30.675958 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7a7a5610-63c3-4a2b-b72a-8e4e9519a81e tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:30.676441 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7a7a5610-63c3-4a2b-b72a-8e4e9519a81e tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:30.677221 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7a7a5610-63c3-4a2b-b72a-8e4e9519a81e tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:30.677661 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7a7a5610-63c3-4a2b-b72a-8e4e9519a81e tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:30.706762 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7a7a5610-63c3-4a2b-b72a-8e4e9519a81e tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042898 May 26 16:52:30.707322 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 478/950] 10.222.0.102 () {58 vars in 1306 bytes} [Thu May 26 16:52:30 2022] GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 16:52:30.764764 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-d3478bda-12c6-49de-a27b-2e165fc67413 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:52:30.765270 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-d3478bda-12c6-49de-a27b-2e165fc67413 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 1d458ca8-f76c-432f-84ff-ab64b839c49d] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:52:30.771237 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d3478bda-12c6-49de-a27b-2e165fc67413 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:30.771697 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d3478bda-12c6-49de-a27b-2e165fc67413 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:30.772523 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d3478bda-12c6-49de-a27b-2e165fc67413 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:30.772965 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d3478bda-12c6-49de-a27b-2e165fc67413 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:30.797823 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-d3478bda-12c6-49de-a27b-2e165fc67413 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 1d458ca8-f76c-432f-84ff-ab64b839c49d] Going to try to terminate instance {{(pid=124267) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 16:52:30.875340 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-d3478bda-12c6-49de-a27b-2e165fc67413 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "DELETE /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d" status: 204 len: 0 microversion: 2.1 time: 0.113890 May 26 16:52:30.876249 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 473/951] 10.222.0.102 () {58 vars in 1243 bytes} [Thu May 26 16:52:30 2022] DELETE /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 16:52:30.886362 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a0f7394f-1d08-47db-9b9c-d5488c5a1e71 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:52:30.886966 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a0f7394f-1d08-47db-9b9c-d5488c5a1e71 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 1d458ca8-f76c-432f-84ff-ab64b839c49d] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:52:30.893521 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a0f7394f-1d08-47db-9b9c-d5488c5a1e71 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:30.893980 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a0f7394f-1d08-47db-9b9c-d5488c5a1e71 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:30.894808 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a0f7394f-1d08-47db-9b9c-d5488c5a1e71 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:30.895260 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a0f7394f-1d08-47db-9b9c-d5488c5a1e71 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:31.025938 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a0f7394f-1d08-47db-9b9c-d5488c5a1e71 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:52:31.033468 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a0f7394f-1d08-47db-9b9c-d5488c5a1e71 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d" status: 200 len: 1677 microversion: 2.1 time: 0.151498 May 26 16:52:31.034040 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 479/952] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:52:30 2022] GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:52:32.051681 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-97cb2acd-1155-4b85-bdd4-010353b67969 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:52:32.052393 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-97cb2acd-1155-4b85-bdd4-010353b67969 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 1d458ca8-f76c-432f-84ff-ab64b839c49d] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:52:32.058933 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-97cb2acd-1155-4b85-bdd4-010353b67969 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:32.059384 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-97cb2acd-1155-4b85-bdd4-010353b67969 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:32.060151 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-97cb2acd-1155-4b85-bdd4-010353b67969 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:32.060622 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-97cb2acd-1155-4b85-bdd4-010353b67969 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:32.189685 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-97cb2acd-1155-4b85-bdd4-010353b67969 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:52:32.198108 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-97cb2acd-1155-4b85-bdd4-010353b67969 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d" status: 200 len: 1677 microversion: 2.1 time: 0.150690 May 26 16:52:32.198684 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 474/953] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:52:32 2022] GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:52:33.215568 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-db15246c-5985-4001-9a03-161281374295 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:52:33.216159 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-db15246c-5985-4001-9a03-161281374295 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 1d458ca8-f76c-432f-84ff-ab64b839c49d] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:52:33.222848 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-db15246c-5985-4001-9a03-161281374295 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:33.223308 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-db15246c-5985-4001-9a03-161281374295 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:33.224109 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-db15246c-5985-4001-9a03-161281374295 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:33.224593 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-db15246c-5985-4001-9a03-161281374295 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:33.359397 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-db15246c-5985-4001-9a03-161281374295 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:52:33.367095 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-db15246c-5985-4001-9a03-161281374295 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d" status: 200 len: 1677 microversion: 2.1 time: 0.155523 May 26 16:52:33.367711 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 480/954] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:52:33 2022] GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:52:34.385698 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0e5b3c97-3dee-436b-b7a9-f3c2d784c122 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:52:34.387059 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0e5b3c97-3dee-436b-b7a9-f3c2d784c122 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 1d458ca8-f76c-432f-84ff-ab64b839c49d] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:52:34.396447 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0e5b3c97-3dee-436b-b7a9-f3c2d784c122 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:34.397095 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0e5b3c97-3dee-436b-b7a9-f3c2d784c122 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:34.398182 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0e5b3c97-3dee-436b-b7a9-f3c2d784c122 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:34.398633 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0e5b3c97-3dee-436b-b7a9-f3c2d784c122 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:34.432657 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-c8acb450-76ce-40f0-832c-5c4aaec9600a req-ce4a983e-110d-42fd-8437-84e8e5ad5cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d458ca8-f76c-432f-84ff-ab64b839c49d", "name": "network-vif-deleted", "tag": "7ecd7624-0f36-4385-b297-434de23e2467"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:52:34.440581 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0e5b3c97-3dee-436b-b7a9-f3c2d784c122 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:34.441221 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-c8acb450-76ce-40f0-832c-5c4aaec9600a req-ce4a983e-110d-42fd-8437-84e8e5ad5cda service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:34.441333 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0e5b3c97-3dee-436b-b7a9-f3c2d784c122 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:34.441674 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-c8acb450-76ce-40f0-832c-5c4aaec9600a req-ce4a983e-110d-42fd-8437-84e8e5ad5cda service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:34.441786 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.objects.instance [None req-0e5b3c97-3dee-436b-b7a9-f3c2d784c122 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lazy-loading 'fault' on Instance uuid 1d458ca8-f76c-432f-84ff-ab64b839c49d {{(pid=124266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:52:34.454922 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-c8acb450-76ce-40f0-832c-5c4aaec9600a req-ce4a983e-110d-42fd-8437-84e8e5ad5cda service nova] Creating event network-vif-deleted:7ecd7624-0f36-4385-b297-434de23e2467 for instance 1d458ca8-f76c-432f-84ff-ab64b839c49d on hv-cinder-83607 May 26 16:52:34.461048 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-c8acb450-76ce-40f0-832c-5c4aaec9600a req-ce4a983e-110d-42fd-8437-84e8e5ad5cda service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.266134 May 26 16:52:34.463033 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 475/955] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:52:34.488555 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0e5b3c97-3dee-436b-b7a9-f3c2d784c122 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e1735e7f54f2d8943a0f55311394b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769867aa4086443a809d8fd8d3b605e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:52:34.496130 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0e5b3c97-3dee-436b-b7a9-f3c2d784c122 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d" status: 200 len: 1330 microversion: 2.1 time: 0.115065 May 26 16:52:34.496740 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 481/956] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:52:34 2022] GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d => generated 1330 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:52:35.513638 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-75b84ca7-23fb-488b-99e4-de6cbc318299 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:52:35.514372 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-75b84ca7-23fb-488b-99e4-de6cbc318299 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 1d458ca8-f76c-432f-84ff-ab64b839c49d] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:52:35.520650 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-75b84ca7-23fb-488b-99e4-de6cbc318299 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:35.521102 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-75b84ca7-23fb-488b-99e4-de6cbc318299 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:35.521864 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-75b84ca7-23fb-488b-99e4-de6cbc318299 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:35.522302 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-75b84ca7-23fb-488b-99e4-de6cbc318299 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:35.536003 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.wsgi [None req-75b84ca7-23fb-488b-99e4-de6cbc318299 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] HTTP exception thrown: Instance 1d458ca8-f76c-432f-84ff-ab64b839c49d could not be found. May 26 16:52:35.537699 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-75b84ca7-23fb-488b-99e4-de6cbc318299 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Request method failure captured: May 26 16:52:35.537699 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: request: GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d HTTP/1.1 May 26 16:52:35.537699 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept: application/json May 26 16:52:35.537699 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept-Encoding: identity May 26 16:52:35.537699 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Connection: close May 26 16:52:35.537699 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Length: 0 May 26 16:52:35.537699 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Type: application/json May 26 16:52:35.537699 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Host: 10.222.0.102 May 26 16:52:35.537699 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Openstack-System-Scope: None May 26 16:52:35.537699 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: User-Agent: python-urllib3/1.26.9 May 26 16:52:35.537699 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Auth-Token: gAAAAABij62tIyfHG9bbMAhr2tBeKPWBiSvUJcs9s6YREEv_6wnAH-mNVdMht8iR1u6blpLBUalvLqTB_SVg9IBiW1W2cjBoehkJn5CAHy0qZ3pNhIj0byh_snroNLM2T21thJ9-tl58Apqya7QASSbtajZPlxLnPFzuiZcaIHf56TIl8heh3pA May 26 16:52:35.537699 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Id: None May 26 16:52:35.537699 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Name: None May 26 16:52:35.537699 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Identity-Status: Confirmed May 26 16:52:35.537699 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Is-Admin-Project: True May 26 16:52:35.537699 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Id: default May 26 16:52:35.537699 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Name: Default May 26 16:52:35.537699 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Id: 769867aa4086443a809d8fd8d3b605e2 May 26 16:52:35.537699 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Name: tempest-AttachVolumeTestJSON-168495231 May 26 16:52:35.537699 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Role: reader,member May 26 16:52:35.537699 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Roles: reader,member May 26 16:52:35.539362 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/769867aa4086443a809d8fd8d3b605e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/769867aa4086443a809d8fd8d3b605e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/769867aa4086443a809d8fd8d3b605e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_769867aa4086443a809d8fd8d3b605e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:52:35.539362 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant: tempest-AttachVolumeTestJSON-168495231 May 26 16:52:35.539362 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Id: 769867aa4086443a809d8fd8d3b605e2 May 26 16:52:35.539362 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Name: tempest-AttachVolumeTestJSON-168495231 May 26 16:52:35.539362 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User: tempest-AttachVolumeTestJSON-168495231-project May 26 16:52:35.539362 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Id: default May 26 16:52:35.539362 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Name: Default May 26 16:52:35.539362 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Id: 2e5e1735e7f54f2d8943a0f55311394b May 26 16:52:35.539362 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Name: tempest-AttachVolumeTestJSON-168495231-project May 26 16:52:35.539362 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: method: > May 26 16:52:35.539362 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: exception: Instance 1d458ca8-f76c-432f-84ff-ab64b839c49d could not be found. May 26 16:52:35.539362 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: action_args: {'id': '1d458ca8-f76c-432f-84ff-ab64b839c49d'} May 26 16:52:35.540900 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:52:35.540900 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:52:35.540900 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:52:35.540900 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:52:35.540900 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:52:35.540900 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:52:35.540900 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:52:35.540900 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:52:35.540900 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:52:35.540900 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:52:35.540900 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d458ca8-f76c-432f-84ff-ab64b839c49d could not be found. May 26 16:52:35.540900 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:52:35.540900 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:52:35.540900 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:52:35.540900 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:52:35.540900 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:52:35.540900 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:52:35.540900 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:52:35.540900 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:52:35.540900 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:52:35.542613 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:52:35.542613 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 16:52:35.542613 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 16:52:35.542613 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:52:35.542613 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:52:35.542613 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:52:35.542613 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:52:35.542613 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d458ca8-f76c-432f-84ff-ab64b839c49d could not be found. May 26 16:52:35.542613 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:52:35.542613 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:52:35.542613 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:52:35.542613 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:52:35.542613 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:52:35.542613 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:52:35.542613 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:52:35.542613 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:52:35.542613 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d458ca8-f76c-432f-84ff-ab64b839c49d could not be found. May 26 16:52:35.542613 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:52:35.544132 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-75b84ca7-23fb-488b-99e4-de6cbc318299 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Returning 404 to user: Instance 1d458ca8-f76c-432f-84ff-ab64b839c49d could not be found. {{(pid=124267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:52:35.544132 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-75b84ca7-23fb-488b-99e4-de6cbc318299 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d" status: 404 len: 111 microversion: 2.1 time: 0.030121 May 26 16:52:35.544132 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 476/957] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:52:35 2022] GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 16:52:35.548665 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-5d645ab8-b8a3-40d3-a86e-44c7944a18b5 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '.version_select at 0x7f93a3f225e0>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:52:35.551831 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5d645ab8-b8a3-40d3-a86e-44c7944a18b5 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [eb73edd3-7478-4567-8669-b02774504c39] AMQP server on 10.222.0.102:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 16:52:36.560041 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO oslo.messaging._drivers.impl_rabbit [None req-5d645ab8-b8a3-40d3-a86e-44c7944a18b5 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [eb73edd3-7478-4567-8669-b02774504c39] Reconnected to AMQP server on 10.222.0.102:5672 via [amqp] client with port 50890. May 26 16:52:36.581000 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-5d645ab8-b8a3-40d3-a86e-44c7944a18b5 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-305353559" status: 202 len: 0 microversion: 2.1 time: 1.036009 May 26 16:52:36.581621 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 482/958] 10.222.0.102 () {58 vars in 1222 bytes} [Thu May 26 16:52:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-305353559 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 16:52:39.452605 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-f41ac749-7fce-41dd-9443-281ecd585381 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:52:39.452605 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-f41ac749-7fce-41dd-9443-281ecd585381 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 1d458ca8-f76c-432f-84ff-ab64b839c49d] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:52:39.457701 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f41ac749-7fce-41dd-9443-281ecd585381 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:39.458145 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f41ac749-7fce-41dd-9443-281ecd585381 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:39.458927 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f41ac749-7fce-41dd-9443-281ecd585381 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:39.459349 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f41ac749-7fce-41dd-9443-281ecd585381 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:39.475139 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.wsgi [None req-f41ac749-7fce-41dd-9443-281ecd585381 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] HTTP exception thrown: Instance 1d458ca8-f76c-432f-84ff-ab64b839c49d could not be found. May 26 16:52:39.476734 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-f41ac749-7fce-41dd-9443-281ecd585381 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Request method failure captured: May 26 16:52:39.476734 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: request: DELETE /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d HTTP/1.1 May 26 16:52:39.476734 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept: application/json May 26 16:52:39.476734 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept-Encoding: identity May 26 16:52:39.476734 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Connection: close May 26 16:52:39.476734 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Length: 0 May 26 16:52:39.476734 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Type: application/json May 26 16:52:39.476734 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Host: 10.222.0.102 May 26 16:52:39.476734 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Openstack-System-Scope: None May 26 16:52:39.476734 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: User-Agent: python-urllib3/1.26.9 May 26 16:52:39.476734 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Auth-Token: gAAAAABij62tIyfHG9bbMAhr2tBeKPWBiSvUJcs9s6YREEv_6wnAH-mNVdMht8iR1u6blpLBUalvLqTB_SVg9IBiW1W2cjBoehkJn5CAHy0qZ3pNhIj0byh_snroNLM2T21thJ9-tl58Apqya7QASSbtajZPlxLnPFzuiZcaIHf56TIl8heh3pA May 26 16:52:39.476734 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Id: None May 26 16:52:39.476734 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Name: None May 26 16:52:39.476734 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Identity-Status: Confirmed May 26 16:52:39.476734 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Is-Admin-Project: True May 26 16:52:39.476734 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Id: default May 26 16:52:39.476734 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Name: Default May 26 16:52:39.476734 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Id: 769867aa4086443a809d8fd8d3b605e2 May 26 16:52:39.476734 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Name: tempest-AttachVolumeTestJSON-168495231 May 26 16:52:39.476734 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Role: reader,member May 26 16:52:39.476734 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Roles: reader,member May 26 16:52:39.479020 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/769867aa4086443a809d8fd8d3b605e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/769867aa4086443a809d8fd8d3b605e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/769867aa4086443a809d8fd8d3b605e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_769867aa4086443a809d8fd8d3b605e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:52:39.479020 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant: tempest-AttachVolumeTestJSON-168495231 May 26 16:52:39.479020 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Id: 769867aa4086443a809d8fd8d3b605e2 May 26 16:52:39.479020 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Name: tempest-AttachVolumeTestJSON-168495231 May 26 16:52:39.479020 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User: tempest-AttachVolumeTestJSON-168495231-project May 26 16:52:39.479020 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Id: default May 26 16:52:39.479020 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Name: Default May 26 16:52:39.479020 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Id: 2e5e1735e7f54f2d8943a0f55311394b May 26 16:52:39.479020 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Name: tempest-AttachVolumeTestJSON-168495231-project May 26 16:52:39.479020 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: method: > May 26 16:52:39.479020 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: exception: Instance 1d458ca8-f76c-432f-84ff-ab64b839c49d could not be found. May 26 16:52:39.479020 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: action_args: {'id': '1d458ca8-f76c-432f-84ff-ab64b839c49d'} May 26 16:52:39.480062 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:52:39.480062 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:52:39.480062 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:52:39.480062 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:52:39.480062 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:52:39.480062 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:52:39.480062 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:52:39.480062 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:52:39.480062 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:52:39.480062 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:52:39.480062 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d458ca8-f76c-432f-84ff-ab64b839c49d could not be found. May 26 16:52:39.480062 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:52:39.480062 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:52:39.480062 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:52:39.480062 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:52:39.480062 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:52:39.480062 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:52:39.480062 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:52:39.480062 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:52:39.480062 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:52:39.481638 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:52:39.481638 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 16:52:39.481638 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 16:52:39.481638 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 16:52:39.481638 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 16:52:39.481638 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:52:39.481638 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:52:39.481638 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:52:39.481638 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:52:39.481638 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d458ca8-f76c-432f-84ff-ab64b839c49d could not be found. May 26 16:52:39.481638 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:52:39.481638 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:52:39.481638 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:52:39.481638 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:52:39.481638 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:52:39.481638 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:52:39.481638 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:52:39.481638 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:52:39.481638 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d458ca8-f76c-432f-84ff-ab64b839c49d could not be found. May 26 16:52:39.481638 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:52:39.483262 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-f41ac749-7fce-41dd-9443-281ecd585381 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Returning 404 to user: Instance 1d458ca8-f76c-432f-84ff-ab64b839c49d could not be found. {{(pid=124267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:52:39.483262 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-f41ac749-7fce-41dd-9443-281ecd585381 tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "DELETE /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d" status: 404 len: 111 microversion: 2.1 time: 0.032672 May 26 16:52:39.483262 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 477/959] 10.222.0.102 () {58 vars in 1243 bytes} [Thu May 26 16:52:39 2022] DELETE /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 16:52:39.487968 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f275c5e1-7b37-4974-9d80-eff19b39042d tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:52:39.488617 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f275c5e1-7b37-4974-9d80-eff19b39042d tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 1d458ca8-f76c-432f-84ff-ab64b839c49d] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:52:39.495376 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f275c5e1-7b37-4974-9d80-eff19b39042d tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:39.495827 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f275c5e1-7b37-4974-9d80-eff19b39042d tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:39.496739 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f275c5e1-7b37-4974-9d80-eff19b39042d tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:39.497171 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f275c5e1-7b37-4974-9d80-eff19b39042d tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:39.511917 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-f275c5e1-7b37-4974-9d80-eff19b39042d tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] HTTP exception thrown: Instance 1d458ca8-f76c-432f-84ff-ab64b839c49d could not be found. May 26 16:52:39.513633 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f275c5e1-7b37-4974-9d80-eff19b39042d tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Request method failure captured: May 26 16:52:39.513633 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d HTTP/1.1 May 26 16:52:39.513633 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept: application/json May 26 16:52:39.513633 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity May 26 16:52:39.513633 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Connection: close May 26 16:52:39.513633 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Length: 0 May 26 16:52:39.513633 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Type: application/json May 26 16:52:39.513633 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Host: 10.222.0.102 May 26 16:52:39.513633 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None May 26 16:52:39.513633 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 May 26 16:52:39.513633 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABij62tIyfHG9bbMAhr2tBeKPWBiSvUJcs9s6YREEv_6wnAH-mNVdMht8iR1u6blpLBUalvLqTB_SVg9IBiW1W2cjBoehkJn5CAHy0qZ3pNhIj0byh_snroNLM2T21thJ9-tl58Apqya7QASSbtajZPlxLnPFzuiZcaIHf56TIl8heh3pA May 26 16:52:39.513633 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Id: None May 26 16:52:39.513633 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Name: None May 26 16:52:39.513633 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed May 26 16:52:39.513633 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True May 26 16:52:39.513633 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default May 26 16:52:39.513633 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default May 26 16:52:39.513633 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Id: 769867aa4086443a809d8fd8d3b605e2 May 26 16:52:39.513633 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-AttachVolumeTestJSON-168495231 May 26 16:52:39.513633 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Role: reader,member May 26 16:52:39.513633 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Roles: reader,member May 26 16:52:39.515242 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/769867aa4086443a809d8fd8d3b605e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/769867aa4086443a809d8fd8d3b605e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/769867aa4086443a809d8fd8d3b605e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_769867aa4086443a809d8fd8d3b605e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:52:39.515242 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-AttachVolumeTestJSON-168495231 May 26 16:52:39.515242 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Id: 769867aa4086443a809d8fd8d3b605e2 May 26 16:52:39.515242 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-AttachVolumeTestJSON-168495231 May 26 16:52:39.515242 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User: tempest-AttachVolumeTestJSON-168495231-project May 26 16:52:39.515242 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default May 26 16:52:39.515242 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default May 26 16:52:39.515242 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Id: 2e5e1735e7f54f2d8943a0f55311394b May 26 16:52:39.515242 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-AttachVolumeTestJSON-168495231-project May 26 16:52:39.515242 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: method: > May 26 16:52:39.515242 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: exception: Instance 1d458ca8-f76c-432f-84ff-ab64b839c49d could not be found. May 26 16:52:39.515242 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: action_args: {'id': '1d458ca8-f76c-432f-84ff-ab64b839c49d'} May 26 16:52:39.516163 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:52:39.516163 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:52:39.516163 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:52:39.516163 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:52:39.516163 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:52:39.516163 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:52:39.516163 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:52:39.516163 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:52:39.516163 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:52:39.516163 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:52:39.516163 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d458ca8-f76c-432f-84ff-ab64b839c49d could not be found. May 26 16:52:39.516163 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:52:39.516163 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:52:39.516163 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:52:39.516163 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:52:39.516163 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:52:39.516163 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:52:39.516163 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:52:39.516163 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:52:39.516163 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:52:39.517826 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:52:39.517826 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 16:52:39.517826 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 16:52:39.517826 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:52:39.517826 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:52:39.517826 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:52:39.517826 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:52:39.517826 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d458ca8-f76c-432f-84ff-ab64b839c49d could not be found. May 26 16:52:39.517826 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:52:39.517826 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:52:39.517826 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:52:39.517826 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:52:39.517826 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:52:39.517826 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:52:39.517826 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:52:39.517826 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:52:39.517826 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d458ca8-f76c-432f-84ff-ab64b839c49d could not be found. May 26 16:52:39.517826 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:52:39.519388 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f275c5e1-7b37-4974-9d80-eff19b39042d tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Returning 404 to user: Instance 1d458ca8-f76c-432f-84ff-ab64b839c49d could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:52:39.519388 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f275c5e1-7b37-4974-9d80-eff19b39042d tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d" status: 404 len: 111 microversion: 2.1 time: 0.031435 May 26 16:52:39.519388 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 483/960] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:52:39 2022] GET /compute/v2.1/servers/1d458ca8-f76c-432f-84ff-ab64b839c49d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 16:52:40.653188 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-b99709e0-ec55-4da8-8132-b8c251703e6d tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:52:40.653731 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-b99709e0-ec55-4da8-8132-b8c251703e6d tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:52:40.661551 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b99709e0-ec55-4da8-8132-b8c251703e6d tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:40.661753 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b99709e0-ec55-4da8-8132-b8c251703e6d tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:40.662502 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b99709e0-ec55-4da8-8132-b8c251703e6d tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:40.662941 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b99709e0-ec55-4da8-8132-b8c251703e6d tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:40.678062 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.wsgi [None req-b99709e0-ec55-4da8-8132-b8c251703e6d tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] HTTP exception thrown: Instance 15756f2d-4f17-4b50-b02e-4cf50051ec29 could not be found. May 26 16:52:40.679632 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-b99709e0-ec55-4da8-8132-b8c251703e6d tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Request method failure captured: May 26 16:52:40.679632 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: request: DELETE /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 HTTP/1.1 May 26 16:52:40.679632 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept: application/json May 26 16:52:40.679632 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept-Encoding: identity May 26 16:52:40.679632 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Connection: close May 26 16:52:40.679632 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Length: 0 May 26 16:52:40.679632 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Type: application/json May 26 16:52:40.679632 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Host: 10.222.0.102 May 26 16:52:40.679632 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Openstack-System-Scope: None May 26 16:52:40.679632 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: User-Agent: python-urllib3/1.26.9 May 26 16:52:40.679632 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Auth-Token: gAAAAABij62tIyfHG9bbMAhr2tBeKPWBiSvUJcs9s6YREEv_6wnAH-mNVdMht8iR1u6blpLBUalvLqTB_SVg9IBiW1W2cjBoehkJn5CAHy0qZ3pNhIj0byh_snroNLM2T21thJ9-tl58Apqya7QASSbtajZPlxLnPFzuiZcaIHf56TIl8heh3pA May 26 16:52:40.679632 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Id: None May 26 16:52:40.679632 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Name: None May 26 16:52:40.679632 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Identity-Status: Confirmed May 26 16:52:40.679632 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Is-Admin-Project: True May 26 16:52:40.679632 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Id: default May 26 16:52:40.679632 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Name: Default May 26 16:52:40.679632 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Id: 769867aa4086443a809d8fd8d3b605e2 May 26 16:52:40.679632 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Name: tempest-AttachVolumeTestJSON-168495231 May 26 16:52:40.679632 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Role: reader,member May 26 16:52:40.679632 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Roles: reader,member May 26 16:52:40.681218 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/769867aa4086443a809d8fd8d3b605e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/769867aa4086443a809d8fd8d3b605e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/769867aa4086443a809d8fd8d3b605e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_769867aa4086443a809d8fd8d3b605e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:52:40.681218 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant: tempest-AttachVolumeTestJSON-168495231 May 26 16:52:40.681218 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Id: 769867aa4086443a809d8fd8d3b605e2 May 26 16:52:40.681218 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Name: tempest-AttachVolumeTestJSON-168495231 May 26 16:52:40.681218 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User: tempest-AttachVolumeTestJSON-168495231-project May 26 16:52:40.681218 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Id: default May 26 16:52:40.681218 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Name: Default May 26 16:52:40.681218 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Id: 2e5e1735e7f54f2d8943a0f55311394b May 26 16:52:40.681218 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Name: tempest-AttachVolumeTestJSON-168495231-project May 26 16:52:40.681218 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: method: > May 26 16:52:40.681218 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: exception: Instance 15756f2d-4f17-4b50-b02e-4cf50051ec29 could not be found. May 26 16:52:40.681218 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: action_args: {'id': '15756f2d-4f17-4b50-b02e-4cf50051ec29'} May 26 16:52:40.682068 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:52:40.682068 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:52:40.682068 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:52:40.682068 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:52:40.682068 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:52:40.682068 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:52:40.682068 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:52:40.682068 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:52:40.682068 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:52:40.682068 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:52:40.682068 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15756f2d-4f17-4b50-b02e-4cf50051ec29 could not be found. May 26 16:52:40.682068 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:52:40.682068 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:52:40.682068 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:52:40.682068 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:52:40.682068 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:52:40.682068 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:52:40.682068 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:52:40.682068 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:52:40.682068 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:52:40.683384 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:52:40.683384 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 16:52:40.683384 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 16:52:40.683384 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 16:52:40.683384 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 16:52:40.683384 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:52:40.683384 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:52:40.683384 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:52:40.683384 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:52:40.683384 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15756f2d-4f17-4b50-b02e-4cf50051ec29 could not be found. May 26 16:52:40.683384 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:52:40.683384 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:52:40.683384 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:52:40.683384 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:52:40.683384 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:52:40.683384 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:52:40.683384 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:52:40.683384 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:52:40.683384 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15756f2d-4f17-4b50-b02e-4cf50051ec29 could not be found. May 26 16:52:40.683384 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:52:40.684631 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-b99709e0-ec55-4da8-8132-b8c251703e6d tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Returning 404 to user: Instance 15756f2d-4f17-4b50-b02e-4cf50051ec29 could not be found. {{(pid=124267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:52:40.684631 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-b99709e0-ec55-4da8-8132-b8c251703e6d tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "DELETE /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 404 len: 111 microversion: 2.1 time: 0.032397 May 26 16:52:40.684631 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 478/961] 10.222.0.102 () {58 vars in 1243 bytes} [Thu May 26 16:52:40 2022] DELETE /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 16:52:40.690346 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a9c1e117-50e2-4b98-a88f-de19aa04646b tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:52:40.690951 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a9c1e117-50e2-4b98-a88f-de19aa04646b tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] [instance: 15756f2d-4f17-4b50-b02e-4cf50051ec29] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:52:40.697437 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a9c1e117-50e2-4b98-a88f-de19aa04646b tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:40.697888 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a9c1e117-50e2-4b98-a88f-de19aa04646b tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:40.698654 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a9c1e117-50e2-4b98-a88f-de19aa04646b tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:40.699094 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a9c1e117-50e2-4b98-a88f-de19aa04646b tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:40.701772 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:52:40.714546 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-a9c1e117-50e2-4b98-a88f-de19aa04646b tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] HTTP exception thrown: Instance 15756f2d-4f17-4b50-b02e-4cf50051ec29 could not be found. May 26 16:52:40.716110 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a9c1e117-50e2-4b98-a88f-de19aa04646b tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Request method failure captured: May 26 16:52:40.716110 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 HTTP/1.1 May 26 16:52:40.716110 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept: application/json May 26 16:52:40.716110 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity May 26 16:52:40.716110 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Connection: close May 26 16:52:40.716110 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Length: 0 May 26 16:52:40.716110 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Type: application/json May 26 16:52:40.716110 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Host: 10.222.0.102 May 26 16:52:40.716110 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None May 26 16:52:40.716110 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 May 26 16:52:40.716110 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABij62tIyfHG9bbMAhr2tBeKPWBiSvUJcs9s6YREEv_6wnAH-mNVdMht8iR1u6blpLBUalvLqTB_SVg9IBiW1W2cjBoehkJn5CAHy0qZ3pNhIj0byh_snroNLM2T21thJ9-tl58Apqya7QASSbtajZPlxLnPFzuiZcaIHf56TIl8heh3pA May 26 16:52:40.716110 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Id: None May 26 16:52:40.716110 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Name: None May 26 16:52:40.716110 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed May 26 16:52:40.716110 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True May 26 16:52:40.716110 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default May 26 16:52:40.716110 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default May 26 16:52:40.716110 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Id: 769867aa4086443a809d8fd8d3b605e2 May 26 16:52:40.716110 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-AttachVolumeTestJSON-168495231 May 26 16:52:40.716110 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Role: reader,member May 26 16:52:40.716110 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Roles: reader,member May 26 16:52:40.717685 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/769867aa4086443a809d8fd8d3b605e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/769867aa4086443a809d8fd8d3b605e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/769867aa4086443a809d8fd8d3b605e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_769867aa4086443a809d8fd8d3b605e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:52:40.717685 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-AttachVolumeTestJSON-168495231 May 26 16:52:40.717685 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Id: 769867aa4086443a809d8fd8d3b605e2 May 26 16:52:40.717685 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-AttachVolumeTestJSON-168495231 May 26 16:52:40.717685 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User: tempest-AttachVolumeTestJSON-168495231-project May 26 16:52:40.717685 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default May 26 16:52:40.717685 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default May 26 16:52:40.717685 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Id: 2e5e1735e7f54f2d8943a0f55311394b May 26 16:52:40.717685 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-AttachVolumeTestJSON-168495231-project May 26 16:52:40.717685 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: method: > May 26 16:52:40.717685 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: exception: Instance 15756f2d-4f17-4b50-b02e-4cf50051ec29 could not be found. May 26 16:52:40.717685 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: action_args: {'id': '15756f2d-4f17-4b50-b02e-4cf50051ec29'} May 26 16:52:40.718695 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:52:40.718695 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:52:40.718695 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:52:40.718695 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:52:40.718695 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:52:40.718695 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:52:40.718695 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:52:40.718695 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:52:40.718695 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:52:40.718695 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:52:40.718695 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15756f2d-4f17-4b50-b02e-4cf50051ec29 could not be found. May 26 16:52:40.718695 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:52:40.718695 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:52:40.718695 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:52:40.718695 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:52:40.718695 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:52:40.718695 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:52:40.718695 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:52:40.718695 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:52:40.718695 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:52:40.720183 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:52:40.720183 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 16:52:40.720183 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 16:52:40.720183 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:52:40.720183 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:52:40.720183 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:52:40.720183 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:52:40.720183 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15756f2d-4f17-4b50-b02e-4cf50051ec29 could not be found. May 26 16:52:40.720183 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:52:40.720183 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:52:40.720183 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:52:40.720183 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:52:40.720183 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:52:40.720183 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:52:40.720183 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:52:40.720183 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:52:40.720183 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15756f2d-4f17-4b50-b02e-4cf50051ec29 could not be found. May 26 16:52:40.720183 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:52:40.721751 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a9c1e117-50e2-4b98-a88f-de19aa04646b tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] Returning 404 to user: Instance 15756f2d-4f17-4b50-b02e-4cf50051ec29 could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:52:40.721751 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a9c1e117-50e2-4b98-a88f-de19aa04646b tempest-AttachVolumeTestJSON-168495231 tempest-AttachVolumeTestJSON-168495231-project] 10.222.0.102 "GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29" status: 404 len: 111 microversion: 2.1 time: 0.031403 May 26 16:52:40.721751 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 484/962] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:52:40 2022] GET /compute/v2.1/servers/15756f2d-4f17-4b50-b02e-4cf50051ec29 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 16:52:50.473312 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-a2b08175-a637-486b-ba7d-4df51731e69d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Action: 'create', calling method: .version_select at 0x7f93a3cdba60>, body: {"keypair": {"name": "tempest-keypair-1988310797", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1crSCWt+/87fUQPpfDrpG7SyO0+xTp9ukH3cYdjU2SZlss9LmgMJZkAyaVdKWkrm/m668GFE5ee6V8VtSjeDdh6KEpODVhJ4UCTuh3ljJoEDjIeSX+HVtNdR3tD9DY4g=="}} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:52:50.491078 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.quota [None req-a2b08175-a637-486b-ba7d-4df51731e69d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Getting quotas for project c56b7ca2b1f54ae782302bead8a35b01. Resources: {'key_pairs'} {{(pid=124267) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:52:50.496001 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.quota [None req-a2b08175-a637-486b-ba7d-4df51731e69d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Getting quotas for user 75cc85261ad441f8993877a959bdd97b and project c56b7ca2b1f54ae782302bead8a35b01. Resources: {'key_pairs'} {{(pid=124267) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:52:50.521974 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-a2b08175-a637-486b-ba7d-4df51731e69d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.181352 May 26 16:52:50.522499 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 479/963] 10.222.0.102 () {60 vars in 1163 bytes} [Thu May 26 16:52:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:52:51.899455 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3ebd5e19-01a8-44a6-8bba-a7a10ce4df18 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1853192849", "imageRef": "d74c4a51-21fe-41d5-865a-cb93604ac3aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1ef1a782-8a32-40c0-8c50-f68f3f393fb7"}], "security_groups": [{"name": "tempest-securitygroup--1784042116"}], "key_name": "tempest-keypair-1988310797", "user_data": "}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:52:51.908850 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:52:52.013439 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.network.neutron [None req-3ebd5e19-01a8-44a6-8bba-a7a10ce4df18 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] validate_networks() for [('1ef1a782-8a32-40c0-8c50-f68f3f393fb7', None, None, None, None, None)] {{(pid=124266) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:52:52.456715 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-3ebd5e19-01a8-44a6-8bba-a7a10ce4df18 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Flavor limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:52:52.457382 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-3ebd5e19-01a8-44a6-8bba-a7a10ce4df18 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Image limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:52:52.458011 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-3ebd5e19-01a8-44a6-8bba-a7a10ce4df18 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Flavor pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:52:52.458434 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-3ebd5e19-01a8-44a6-8bba-a7a10ce4df18 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Image pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:52:52.458852 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-3ebd5e19-01a8-44a6-8bba-a7a10ce4df18 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:52:52.470712 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3ebd5e19-01a8-44a6-8bba-a7a10ce4df18 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:52.471510 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3ebd5e19-01a8-44a6-8bba-a7a10ce4df18 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:52.472452 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3ebd5e19-01a8-44a6-8bba-a7a10ce4df18 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:52.473139 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3ebd5e19-01a8-44a6-8bba-a7a10ce4df18 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:52.492112 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-3ebd5e19-01a8-44a6-8bba-a7a10ce4df18 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Getting quotas for project c56b7ca2b1f54ae782302bead8a35b01. Resources: {'cores', 'instances', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:52:52.496905 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-3ebd5e19-01a8-44a6-8bba-a7a10ce4df18 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Getting quotas for user 75cc85261ad441f8993877a959bdd97b and project c56b7ca2b1f54ae782302bead8a35b01. Resources: {'cores', 'instances', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:52:52.512318 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-3ebd5e19-01a8-44a6-8bba-a7a10ce4df18 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Going to run 1 instances... {{(pid=124266) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:52:52.514724 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-3ebd5e19-01a8-44a6-8bba-a7a10ce4df18 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d74c4a51-21fe-41d5-865a-cb93604ac3aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:52:52.564574 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-3ebd5e19-01a8-44a6-8bba-a7a10ce4df18 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.670062 May 26 16:52:52.565581 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 485/964] 10.222.0.102 () {60 vars in 1151 bytes} [Thu May 26 16:52:51 2022] POST /compute/v2.1/servers => generated 404 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 16:52:52.572143 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:52:52.577135 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-76f1170b-87ea-4a9d-a2e3-fae3463784cc tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:52:52.577946 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-76f1170b-87ea-4a9d-a2e3-fae3463784cc tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:52:52.651311 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-76f1170b-87ea-4a9d-a2e3-fae3463784cc tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:52:52.660120 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-76f1170b-87ea-4a9d-a2e3-fae3463784cc tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3" status: 200 len: 1246 microversion: 2.1 time: 0.088558 May 26 16:52:52.668629 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 480/965] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:52:52 2022] GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:52:53.678979 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-77af8824-b16b-4047-a4e2-3d12e4e98088 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:52:53.679614 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-77af8824-b16b-4047-a4e2-3d12e4e98088 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:52:53.687135 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-77af8824-b16b-4047-a4e2-3d12e4e98088 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:53.687602 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-77af8824-b16b-4047-a4e2-3d12e4e98088 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:53.688412 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-77af8824-b16b-4047-a4e2-3d12e4e98088 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:53.689113 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-77af8824-b16b-4047-a4e2-3d12e4e98088 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:53.761580 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-77af8824-b16b-4047-a4e2-3d12e4e98088 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:52:53.771314 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-77af8824-b16b-4047-a4e2-3d12e4e98088 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3" status: 200 len: 1306 microversion: 2.1 time: 0.097339 May 26 16:52:53.772731 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 486/966] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:52:53 2022] GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 => generated 1306 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:52:54.791104 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-8ec57345-10f5-4029-8fe3-1f3d4edd1e81 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:52:54.791855 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-8ec57345-10f5-4029-8fe3-1f3d4edd1e81 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:52:54.798766 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8ec57345-10f5-4029-8fe3-1f3d4edd1e81 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:54.799440 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8ec57345-10f5-4029-8fe3-1f3d4edd1e81 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:54.800286 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8ec57345-10f5-4029-8fe3-1f3d4edd1e81 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:54.800813 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8ec57345-10f5-4029-8fe3-1f3d4edd1e81 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:54.952449 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-8ec57345-10f5-4029-8fe3-1f3d4edd1e81 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:52:54.960074 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-8ec57345-10f5-4029-8fe3-1f3d4edd1e81 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3" status: 200 len: 1372 microversion: 2.1 time: 0.174999 May 26 16:52:54.960986 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 481/967] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:52:54 2022] GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 => generated 1372 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:52:55.346677 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-ccbee175-e8ea-4b2e-8db9-4e12cb7bfffb req-7737f6ca-5eab-4ad4-9068-b62325514fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48502e6c-e7ed-4b82-9045-1e2c9a2be1d3", "tag": "6668c14d-9567-4399-8261-8e6aad0fb4b4"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:52:55.376360 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-ccbee175-e8ea-4b2e-8db9-4e12cb7bfffb req-7737f6ca-5eab-4ad4-9068-b62325514fd8 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:55.376852 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-ccbee175-e8ea-4b2e-8db9-4e12cb7bfffb req-7737f6ca-5eab-4ad4-9068-b62325514fd8 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:55.388865 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-ccbee175-e8ea-4b2e-8db9-4e12cb7bfffb req-7737f6ca-5eab-4ad4-9068-b62325514fd8 service nova] Creating event network-changed:6668c14d-9567-4399-8261-8e6aad0fb4b4 for instance 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 on hv-cinder-83607 May 26 16:52:55.393914 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-ccbee175-e8ea-4b2e-8db9-4e12cb7bfffb req-7737f6ca-5eab-4ad4-9068-b62325514fd8 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050967 May 26 16:52:55.394512 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 487/968] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:52:55.979205 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-bacf7c22-6882-47dc-8715-0ed83957849b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:52:55.979806 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-bacf7c22-6882-47dc-8715-0ed83957849b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:52:55.986220 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bacf7c22-6882-47dc-8715-0ed83957849b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:55.986661 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bacf7c22-6882-47dc-8715-0ed83957849b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:55.987413 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bacf7c22-6882-47dc-8715-0ed83957849b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:55.987842 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bacf7c22-6882-47dc-8715-0ed83957849b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:56.136801 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-bacf7c22-6882-47dc-8715-0ed83957849b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:52:56.144231 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-bacf7c22-6882-47dc-8715-0ed83957849b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3" status: 200 len: 1372 microversion: 2.1 time: 0.170262 May 26 16:52:56.144827 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 482/969] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:52:55 2022] GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:52:57.162007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-5aca0044-21f1-465d-9d78-b7886af1a8d1 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:52:57.162622 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-5aca0044-21f1-465d-9d78-b7886af1a8d1 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:52:57.169671 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5aca0044-21f1-465d-9d78-b7886af1a8d1 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:57.170130 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5aca0044-21f1-465d-9d78-b7886af1a8d1 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:57.170913 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5aca0044-21f1-465d-9d78-b7886af1a8d1 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:57.171352 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5aca0044-21f1-465d-9d78-b7886af1a8d1 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:57.310332 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-5aca0044-21f1-465d-9d78-b7886af1a8d1 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:52:57.318931 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-5aca0044-21f1-465d-9d78-b7886af1a8d1 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3" status: 200 len: 1372 microversion: 2.1 time: 0.161205 May 26 16:52:57.319713 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 488/970] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:52:57 2022] GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:52:58.336808 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-a44e78a1-4dfd-46ea-86d8-e211ae7fec48 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:52:58.337495 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-a44e78a1-4dfd-46ea-86d8-e211ae7fec48 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:52:58.339864 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:52:58.345468 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a44e78a1-4dfd-46ea-86d8-e211ae7fec48 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:58.345907 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a44e78a1-4dfd-46ea-86d8-e211ae7fec48 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:58.346682 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a44e78a1-4dfd-46ea-86d8-e211ae7fec48 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:58.347116 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a44e78a1-4dfd-46ea-86d8-e211ae7fec48 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:58.482732 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-a44e78a1-4dfd-46ea-86d8-e211ae7fec48 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:52:58.491092 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-a44e78a1-4dfd-46ea-86d8-e211ae7fec48 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3" status: 200 len: 1372 microversion: 2.1 time: 0.158326 May 26 16:52:58.491691 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 483/971] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:52:58 2022] GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:52:59.509174 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-93dae660-1656-4522-8bd4-465c18a36d15 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:52:59.509786 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-93dae660-1656-4522-8bd4-465c18a36d15 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:52:59.516504 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-93dae660-1656-4522-8bd4-465c18a36d15 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:59.516958 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-93dae660-1656-4522-8bd4-465c18a36d15 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:59.517732 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-93dae660-1656-4522-8bd4-465c18a36d15 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:59.518169 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-93dae660-1656-4522-8bd4-465c18a36d15 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:59.651377 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-93dae660-1656-4522-8bd4-465c18a36d15 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:52:59.658891 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-93dae660-1656-4522-8bd4-465c18a36d15 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3" status: 200 len: 1372 microversion: 2.1 time: 0.154235 May 26 16:52:59.659453 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 489/972] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:52:59 2022] GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:00.675493 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-c46c2208-2ec0-4b48-973d-a321138b89f5 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:00.676123 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-c46c2208-2ec0-4b48-973d-a321138b89f5 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:00.683534 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c46c2208-2ec0-4b48-973d-a321138b89f5 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:00.684026 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c46c2208-2ec0-4b48-973d-a321138b89f5 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:00.684842 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c46c2208-2ec0-4b48-973d-a321138b89f5 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:00.685284 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c46c2208-2ec0-4b48-973d-a321138b89f5 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:00.822320 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-c46c2208-2ec0-4b48-973d-a321138b89f5 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:00.829878 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-c46c2208-2ec0-4b48-973d-a321138b89f5 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3" status: 200 len: 1372 microversion: 2.1 time: 0.158510 May 26 16:53:00.830499 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 484/973] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:53:00 2022] GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:01.847207 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6c8a9585-f51d-4535-b04b-40a93bebe555 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:01.847734 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-6c8a9585-f51d-4535-b04b-40a93bebe555 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:01.854856 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6c8a9585-f51d-4535-b04b-40a93bebe555 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:01.855305 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6c8a9585-f51d-4535-b04b-40a93bebe555 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:01.856073 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6c8a9585-f51d-4535-b04b-40a93bebe555 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:01.856544 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6c8a9585-f51d-4535-b04b-40a93bebe555 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:01.985072 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6c8a9585-f51d-4535-b04b-40a93bebe555 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:01.992485 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6c8a9585-f51d-4535-b04b-40a93bebe555 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3" status: 200 len: 1372 microversion: 2.1 time: 0.149190 May 26 16:53:01.993062 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 490/974] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:53:01 2022] GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:02.799582 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-9f183749-893a-4074-ad63-2582011082e9 req-001977f0-af3c-4331-927b-4159dff0df95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48502e6c-e7ed-4b82-9045-1e2c9a2be1d3", "name": "network-vif-plugged", "status": "completed", "tag": "6668c14d-9567-4399-8261-8e6aad0fb4b4"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:53:02.803586 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell0:SELECT=6 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:02.811081 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-9f183749-893a-4074-ad63-2582011082e9 req-001977f0-af3c-4331-927b-4159dff0df95 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:02.811534 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-9f183749-893a-4074-ad63-2582011082e9 req-001977f0-af3c-4331-927b-4159dff0df95 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:02.823068 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-9f183749-893a-4074-ad63-2582011082e9 req-001977f0-af3c-4331-927b-4159dff0df95 service nova] Creating event network-vif-plugged:6668c14d-9567-4399-8261-8e6aad0fb4b4 for instance 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 on hv-cinder-83607 May 26 16:53:02.827974 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-9f183749-893a-4074-ad63-2582011082e9 req-001977f0-af3c-4331-927b-4159dff0df95 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032044 May 26 16:53:02.828605 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 485/975] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:53:03.009685 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-56a6fbc1-83d5-4cc9-bf1b-7423df2be658 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:03.010368 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-56a6fbc1-83d5-4cc9-bf1b-7423df2be658 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:03.012325 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:03.013365 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=6 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:03.019322 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-56a6fbc1-83d5-4cc9-bf1b-7423df2be658 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:03.019774 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-56a6fbc1-83d5-4cc9-bf1b-7423df2be658 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:03.020591 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-56a6fbc1-83d5-4cc9-bf1b-7423df2be658 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:03.021034 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-56a6fbc1-83d5-4cc9-bf1b-7423df2be658 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:03.160410 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-56a6fbc1-83d5-4cc9-bf1b-7423df2be658 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:03.168756 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-56a6fbc1-83d5-4cc9-bf1b-7423df2be658 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3" status: 200 len: 1372 microversion: 2.1 time: 0.162952 May 26 16:53:03.169582 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 491/976] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:53:03 2022] GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:04.186761 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-9a2de85c-2cc8-4e3c-8f40-01d44a93d0d2 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:04.187463 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-9a2de85c-2cc8-4e3c-8f40-01d44a93d0d2 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:04.193985 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9a2de85c-2cc8-4e3c-8f40-01d44a93d0d2 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:04.194436 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9a2de85c-2cc8-4e3c-8f40-01d44a93d0d2 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:04.195211 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9a2de85c-2cc8-4e3c-8f40-01d44a93d0d2 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:04.195645 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9a2de85c-2cc8-4e3c-8f40-01d44a93d0d2 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:04.334429 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-9a2de85c-2cc8-4e3c-8f40-01d44a93d0d2 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:04.342581 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-9a2de85c-2cc8-4e3c-8f40-01d44a93d0d2 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3" status: 200 len: 1372 microversion: 2.1 time: 0.160505 May 26 16:53:04.343145 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 486/977] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:53:04 2022] GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:05.359286 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-cb3584cf-4132-4849-ab3f-d948de511478 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:05.359898 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-cb3584cf-4132-4849-ab3f-d948de511478 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:05.366547 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cb3584cf-4132-4849-ab3f-d948de511478 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:05.367697 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cb3584cf-4132-4849-ab3f-d948de511478 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:05.368491 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cb3584cf-4132-4849-ab3f-d948de511478 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:05.368931 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-cb3584cf-4132-4849-ab3f-d948de511478 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:05.499358 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-cb3584cf-4132-4849-ab3f-d948de511478 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:05.508709 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-cb3584cf-4132-4849-ab3f-d948de511478 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3" status: 200 len: 1563 microversion: 2.1 time: 0.153219 May 26 16:53:05.509300 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 492/978] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:53:05 2022] GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:05.525051 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-b85f2b89-1eb0-4894-a2d5-f4a2eb31ecb3 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:05.525578 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-b85f2b89-1eb0-4894-a2d5-f4a2eb31ecb3 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:05.531980 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b85f2b89-1eb0-4894-a2d5-f4a2eb31ecb3 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:05.532470 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b85f2b89-1eb0-4894-a2d5-f4a2eb31ecb3 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:05.533255 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b85f2b89-1eb0-4894-a2d5-f4a2eb31ecb3 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:05.533696 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b85f2b89-1eb0-4894-a2d5-f4a2eb31ecb3 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:05.609902 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-b85f2b89-1eb0-4894-a2d5-f4a2eb31ecb3 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088676 May 26 16:53:05.610578 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 487/979] 10.222.0.102 () {58 vars in 1279 bytes} [Thu May 26 16:53:05 2022] GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:53:06.781145 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-1997ec16-a739-499e-9f8d-9b445c4b8ff0 req-c0c82d03-bfe7-4c73-91ba-a02f488b5ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48502e6c-e7ed-4b82-9045-1e2c9a2be1d3", "tag": "6668c14d-9567-4399-8261-8e6aad0fb4b4"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:53:06.789747 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-1997ec16-a739-499e-9f8d-9b445c4b8ff0 req-c0c82d03-bfe7-4c73-91ba-a02f488b5ce7 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:06.790292 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-1997ec16-a739-499e-9f8d-9b445c4b8ff0 req-c0c82d03-bfe7-4c73-91ba-a02f488b5ce7 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:06.801193 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-1997ec16-a739-499e-9f8d-9b445c4b8ff0 req-c0c82d03-bfe7-4c73-91ba-a02f488b5ce7 service nova] Creating event network-changed:6668c14d-9567-4399-8261-8e6aad0fb4b4 for instance 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 on hv-cinder-83607 May 26 16:53:06.806284 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-1997ec16-a739-499e-9f8d-9b445c4b8ff0 req-c0c82d03-bfe7-4c73-91ba-a02f488b5ce7 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029043 May 26 16:53:06.807124 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 493/980] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:53:20.398130 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_api:SELECT=9 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:20.398878 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=36 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:20.403512 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-ebf4bfe9-c39c-4aa6-8d01-6b813606509e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:20.404471 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-ebf4bfe9-c39c-4aa6-8d01-6b813606509e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:20.411439 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ebf4bfe9-c39c-4aa6-8d01-6b813606509e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:20.411898 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ebf4bfe9-c39c-4aa6-8d01-6b813606509e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:20.412701 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ebf4bfe9-c39c-4aa6-8d01-6b813606509e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:20.413189 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ebf4bfe9-c39c-4aa6-8d01-6b813606509e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:20.442982 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-ebf4bfe9-c39c-4aa6-8d01-6b813606509e tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046973 May 26 16:53:20.443541 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 488/981] 10.222.0.102 () {60 vars in 1347 bytes} [Thu May 26 16:53:20 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:20.508760 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:20.509496 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=43 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:20.513764 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a7c0ed06-7d8f-4de6-8e85-c8adb5edefab tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:20.514349 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a7c0ed06-7d8f-4de6-8e85-c8adb5edefab tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:20.521625 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a7c0ed06-7d8f-4de6-8e85-c8adb5edefab tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:20.522077 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a7c0ed06-7d8f-4de6-8e85-c8adb5edefab tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:20.523333 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a7c0ed06-7d8f-4de6-8e85-c8adb5edefab tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:20.523768 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a7c0ed06-7d8f-4de6-8e85-c8adb5edefab tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:20.549550 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a7c0ed06-7d8f-4de6-8e85-c8adb5edefab tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Going to try to terminate instance {{(pid=124266) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 16:53:20.629604 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a7c0ed06-7d8f-4de6-8e85-c8adb5edefab tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "DELETE /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 204 len: 0 microversion: 2.20 time: 0.122345 May 26 16:53:20.630399 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 494/982] 10.222.0.102 () {60 vars in 1284 bytes} [Thu May 26 16:53:20 2022] DELETE /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 16:53:20.638880 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-7efdfa11-c967-444f-bb47-a8e8b4a2299a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:20.639488 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-7efdfa11-c967-444f-bb47-a8e8b4a2299a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:20.645787 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7efdfa11-c967-444f-bb47-a8e8b4a2299a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:20.646242 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7efdfa11-c967-444f-bb47-a8e8b4a2299a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:20.647016 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7efdfa11-c967-444f-bb47-a8e8b4a2299a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:20.647948 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7efdfa11-c967-444f-bb47-a8e8b4a2299a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:20.779075 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-7efdfa11-c967-444f-bb47-a8e8b4a2299a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:20.787662 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-7efdfa11-c967-444f-bb47-a8e8b4a2299a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:20.789216 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-7efdfa11-c967-444f-bb47-a8e8b4a2299a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:20.790490 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-7efdfa11-c967-444f-bb47-a8e8b4a2299a tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1728 microversion: 2.20 time: 0.155649 May 26 16:53:20.791158 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 489/983] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:53:20 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:53:21.809124 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d4383b18-e4dc-479c-bc1f-b030dcd6a09d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:21.809805 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d4383b18-e4dc-479c-bc1f-b030dcd6a09d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:21.817219 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d4383b18-e4dc-479c-bc1f-b030dcd6a09d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:21.817670 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d4383b18-e4dc-479c-bc1f-b030dcd6a09d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:21.818454 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d4383b18-e4dc-479c-bc1f-b030dcd6a09d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:21.818892 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d4383b18-e4dc-479c-bc1f-b030dcd6a09d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:21.952389 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d4383b18-e4dc-479c-bc1f-b030dcd6a09d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:21.961088 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d4383b18-e4dc-479c-bc1f-b030dcd6a09d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:21.962800 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d4383b18-e4dc-479c-bc1f-b030dcd6a09d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:21.963979 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d4383b18-e4dc-479c-bc1f-b030dcd6a09d tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1728 microversion: 2.20 time: 0.159265 May 26 16:53:21.964558 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 495/984] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:53:21 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:53:22.982622 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-151b7350-19cc-4331-8684-f9714300e844 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:22.983261 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-151b7350-19cc-4331-8684-f9714300e844 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:22.989880 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-151b7350-19cc-4331-8684-f9714300e844 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:22.990331 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-151b7350-19cc-4331-8684-f9714300e844 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:22.991141 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-151b7350-19cc-4331-8684-f9714300e844 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:22.991582 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-151b7350-19cc-4331-8684-f9714300e844 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:23.125813 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-151b7350-19cc-4331-8684-f9714300e844 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:23.135156 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-151b7350-19cc-4331-8684-f9714300e844 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:23.136940 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-151b7350-19cc-4331-8684-f9714300e844 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4941664ae624d4190ff53e5965db33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:23.138123 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-151b7350-19cc-4331-8684-f9714300e844 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 200 len: 1728 microversion: 2.20 time: 0.159649 May 26 16:53:23.138710 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 490/985] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:53:22 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:53:23.361294 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-1cb880a3-67ee-456b-8f61-cd64c306c3c4 req-cd6c1c79-6991-49d5-b2f2-a86ad380b208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead585f3-8422-41d8-9a7e-babd902216ea", "name": "network-vif-deleted", "tag": "cc45ab72-d2ad-4d48-a593-2e836c66dcb4"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:53:23.370834 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-1cb880a3-67ee-456b-8f61-cd64c306c3c4 req-cd6c1c79-6991-49d5-b2f2-a86ad380b208 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:23.371301 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-1cb880a3-67ee-456b-8f61-cd64c306c3c4 req-cd6c1c79-6991-49d5-b2f2-a86ad380b208 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:23.383600 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-1cb880a3-67ee-456b-8f61-cd64c306c3c4 req-cd6c1c79-6991-49d5-b2f2-a86ad380b208 service nova] Creating event network-vif-deleted:cc45ab72-d2ad-4d48-a593-2e836c66dcb4 for instance ead585f3-8422-41d8-9a7e-babd902216ea on hv-cinder-83607 May 26 16:53:23.389445 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-1cb880a3-67ee-456b-8f61-cd64c306c3c4 req-cd6c1c79-6991-49d5-b2f2-a86ad380b208 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032015 May 26 16:53:23.390127 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 496/986] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:53:24.157453 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-198b7f45-f639-4e55-8106-97fd13b7ccf5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:24.158070 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-198b7f45-f639-4e55-8106-97fd13b7ccf5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:24.165499 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-198b7f45-f639-4e55-8106-97fd13b7ccf5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:24.166068 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-198b7f45-f639-4e55-8106-97fd13b7ccf5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:24.166729 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-198b7f45-f639-4e55-8106-97fd13b7ccf5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:24.167167 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-198b7f45-f639-4e55-8106-97fd13b7ccf5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:24.183089 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.wsgi [None req-198b7f45-f639-4e55-8106-97fd13b7ccf5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] HTTP exception thrown: Instance ead585f3-8422-41d8-9a7e-babd902216ea could not be found. May 26 16:53:24.184800 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-198b7f45-f639-4e55-8106-97fd13b7ccf5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Request method failure captured: May 26 16:53:24.184800 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: request: GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea HTTP/1.1 May 26 16:53:24.184800 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept: application/json May 26 16:53:24.184800 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept-Encoding: identity May 26 16:53:24.184800 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Connection: close May 26 16:53:24.184800 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Length: 0 May 26 16:53:24.184800 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Type: application/json May 26 16:53:24.184800 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Host: 10.222.0.102 May 26 16:53:24.184800 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Openstack-System-Scope: None May 26 16:53:24.184800 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: User-Agent: python-urllib3/1.26.9 May 26 16:53:24.184800 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Auth-Token: gAAAAABij62ls_QXS8BetfnOiLi3iYdBIzuec_Y4yQ_t8KHJ0A0xyCzG_LOLOt-5f5-V8dnJXpYMtB5srQ1zeCtk_mtqtfxFPdfkmymvPMVpsQVd4u1aa-TIjNfqB4QVQu2wpl1jv5k2K6iYwvEhBfjgKxT3Oo8EipT3zl3l-LIsxMEY5W36dlM May 26 16:53:24.184800 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Id: None May 26 16:53:24.184800 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Name: None May 26 16:53:24.184800 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Identity-Status: Confirmed May 26 16:53:24.184800 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Is-Admin-Project: True May 26 16:53:24.184800 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Openstack-Nova-Api-Version: 2.20 May 26 16:53:24.184800 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Id: default May 26 16:53:24.184800 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Name: Default May 26 16:53:24.184800 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Id: a69cba8eb64f4fcc87bbc6960a0abeb0 May 26 16:53:24.184800 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-465880155 May 26 16:53:24.184800 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Role: reader,member May 26 16:53:24.184800 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Roles: reader,member May 26 16:53:24.186579 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/a69cba8eb64f4fcc87bbc6960a0abeb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/a69cba8eb64f4fcc87bbc6960a0abeb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/a69cba8eb64f4fcc87bbc6960a0abeb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_a69cba8eb64f4fcc87bbc6960a0abeb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:53:24.186579 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant: tempest-AttachVolumeShelveTestJSON-465880155 May 26 16:53:24.186579 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Id: a69cba8eb64f4fcc87bbc6960a0abeb0 May 26 16:53:24.186579 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-465880155 May 26 16:53:24.186579 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User: tempest-AttachVolumeShelveTestJSON-465880155-project May 26 16:53:24.186579 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Id: default May 26 16:53:24.186579 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Name: Default May 26 16:53:24.186579 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Id: e4941664ae624d4190ff53e5965db33f May 26 16:53:24.186579 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Name: tempest-AttachVolumeShelveTestJSON-465880155-project May 26 16:53:24.186579 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: method: > May 26 16:53:24.186579 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: exception: Instance ead585f3-8422-41d8-9a7e-babd902216ea could not be found. May 26 16:53:24.186579 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: action_args: {'id': 'ead585f3-8422-41d8-9a7e-babd902216ea'} May 26 16:53:24.191074 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:53:24.191074 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:24.191074 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:53:24.191074 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:53:24.191074 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:53:24.191074 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:53:24.191074 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:53:24.191074 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:53:24.191074 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:53:24.191074 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:53:24.191074 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ead585f3-8422-41d8-9a7e-babd902216ea could not be found. May 26 16:53:24.191074 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:53:24.191074 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:53:24.191074 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:53:24.191074 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:24.191074 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:53:24.191074 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:53:24.191074 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:53:24.191074 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:53:24.191074 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:53:24.192685 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:53:24.192685 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 16:53:24.192685 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 16:53:24.192685 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:53:24.192685 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:53:24.192685 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:53:24.192685 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:53:24.192685 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ead585f3-8422-41d8-9a7e-babd902216ea could not be found. May 26 16:53:24.192685 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:53:24.192685 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:53:24.192685 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:53:24.192685 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:24.192685 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:53:24.192685 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:53:24.192685 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:53:24.192685 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:53:24.192685 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ead585f3-8422-41d8-9a7e-babd902216ea could not be found. May 26 16:53:24.192685 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:53:24.195291 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-198b7f45-f639-4e55-8106-97fd13b7ccf5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Returning 404 to user: Instance ead585f3-8422-41d8-9a7e-babd902216ea could not be found. {{(pid=124267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:53:24.195291 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-198b7f45-f639-4e55-8106-97fd13b7ccf5 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 404 len: 111 microversion: 2.20 time: 0.032876 May 26 16:53:24.195291 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 491/987] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:53:24 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 16:53:24.196082 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2b9c4e77-9d73-4775-9368-0410247795dc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '.version_select at 0x7f93a3d9a5e0>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:24.215876 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2b9c4e77-9d73-4775-9368-0410247795dc tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1967408850" status: 204 len: 0 microversion: 2.20 time: 0.023984 May 26 16:53:24.216564 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 497/988] 10.222.0.102 () {60 vars in 1266 bytes} [Thu May 26 16:53:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1967408850 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 26 16:53:25.973115 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-4d664154-d4d4-413a-8ad1-aad6a12b25f7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:25.973613 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-4d664154-d4d4-413a-8ad1-aad6a12b25f7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:25.980804 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4d664154-d4d4-413a-8ad1-aad6a12b25f7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:25.981260 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4d664154-d4d4-413a-8ad1-aad6a12b25f7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:25.982058 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4d664154-d4d4-413a-8ad1-aad6a12b25f7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:25.982499 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4d664154-d4d4-413a-8ad1-aad6a12b25f7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:25.997579 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.wsgi [None req-4d664154-d4d4-413a-8ad1-aad6a12b25f7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] HTTP exception thrown: Instance ead585f3-8422-41d8-9a7e-babd902216ea could not be found. May 26 16:53:25.999125 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-4d664154-d4d4-413a-8ad1-aad6a12b25f7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Request method failure captured: May 26 16:53:25.999125 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: request: DELETE /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea HTTP/1.1 May 26 16:53:25.999125 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept: application/json May 26 16:53:25.999125 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept-Encoding: identity May 26 16:53:25.999125 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Connection: close May 26 16:53:25.999125 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Length: 0 May 26 16:53:25.999125 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Type: application/json May 26 16:53:25.999125 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Host: 10.222.0.102 May 26 16:53:25.999125 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Openstack-System-Scope: None May 26 16:53:25.999125 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: User-Agent: python-urllib3/1.26.9 May 26 16:53:25.999125 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Auth-Token: gAAAAABij62ls_QXS8BetfnOiLi3iYdBIzuec_Y4yQ_t8KHJ0A0xyCzG_LOLOt-5f5-V8dnJXpYMtB5srQ1zeCtk_mtqtfxFPdfkmymvPMVpsQVd4u1aa-TIjNfqB4QVQu2wpl1jv5k2K6iYwvEhBfjgKxT3Oo8EipT3zl3l-LIsxMEY5W36dlM May 26 16:53:25.999125 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Id: None May 26 16:53:25.999125 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Name: None May 26 16:53:25.999125 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Identity-Status: Confirmed May 26 16:53:25.999125 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Is-Admin-Project: True May 26 16:53:25.999125 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Openstack-Nova-Api-Version: 2.20 May 26 16:53:25.999125 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Id: default May 26 16:53:25.999125 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Name: Default May 26 16:53:25.999125 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Id: a69cba8eb64f4fcc87bbc6960a0abeb0 May 26 16:53:25.999125 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-465880155 May 26 16:53:25.999125 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Role: reader,member May 26 16:53:25.999125 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Roles: reader,member May 26 16:53:26.000816 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/a69cba8eb64f4fcc87bbc6960a0abeb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/a69cba8eb64f4fcc87bbc6960a0abeb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/a69cba8eb64f4fcc87bbc6960a0abeb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_a69cba8eb64f4fcc87bbc6960a0abeb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:53:26.000816 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant: tempest-AttachVolumeShelveTestJSON-465880155 May 26 16:53:26.000816 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Id: a69cba8eb64f4fcc87bbc6960a0abeb0 May 26 16:53:26.000816 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-465880155 May 26 16:53:26.000816 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User: tempest-AttachVolumeShelveTestJSON-465880155-project May 26 16:53:26.000816 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Id: default May 26 16:53:26.000816 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Name: Default May 26 16:53:26.000816 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Id: e4941664ae624d4190ff53e5965db33f May 26 16:53:26.000816 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Name: tempest-AttachVolumeShelveTestJSON-465880155-project May 26 16:53:26.000816 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: method: > May 26 16:53:26.000816 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: exception: Instance ead585f3-8422-41d8-9a7e-babd902216ea could not be found. May 26 16:53:26.000816 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: action_args: {'id': 'ead585f3-8422-41d8-9a7e-babd902216ea'} May 26 16:53:26.001656 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:53:26.001656 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:26.001656 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:53:26.001656 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:53:26.001656 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:53:26.001656 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:53:26.001656 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:53:26.001656 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:53:26.001656 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:53:26.001656 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:53:26.001656 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ead585f3-8422-41d8-9a7e-babd902216ea could not be found. May 26 16:53:26.001656 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:53:26.001656 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:53:26.001656 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:53:26.001656 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:26.001656 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:53:26.001656 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:53:26.001656 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:53:26.001656 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:53:26.001656 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:53:26.002890 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:53:26.002890 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 16:53:26.002890 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 16:53:26.002890 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 16:53:26.002890 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 16:53:26.002890 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:53:26.002890 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:53:26.002890 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:53:26.002890 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:53:26.002890 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ead585f3-8422-41d8-9a7e-babd902216ea could not be found. May 26 16:53:26.002890 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:53:26.002890 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:53:26.002890 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:53:26.002890 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:26.002890 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:53:26.002890 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:53:26.002890 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:53:26.002890 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:53:26.002890 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ead585f3-8422-41d8-9a7e-babd902216ea could not be found. May 26 16:53:26.002890 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:53:26.004107 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-4d664154-d4d4-413a-8ad1-aad6a12b25f7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Returning 404 to user: Instance ead585f3-8422-41d8-9a7e-babd902216ea could not be found. {{(pid=124267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:53:26.004107 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-4d664154-d4d4-413a-8ad1-aad6a12b25f7 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "DELETE /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 404 len: 111 microversion: 2.20 time: 0.031400 May 26 16:53:26.004107 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 492/989] 10.222.0.102 () {60 vars in 1284 bytes} [Thu May 26 16:53:25 2022] DELETE /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 16:53:26.010039 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6f398a84-8500-42e2-8dfc-457a40486bd6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:26.010777 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-6f398a84-8500-42e2-8dfc-457a40486bd6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: ead585f3-8422-41d8-9a7e-babd902216ea] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:26.017048 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6f398a84-8500-42e2-8dfc-457a40486bd6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:26.017504 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6f398a84-8500-42e2-8dfc-457a40486bd6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:26.018278 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6f398a84-8500-42e2-8dfc-457a40486bd6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:26.018718 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6f398a84-8500-42e2-8dfc-457a40486bd6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:26.032659 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-6f398a84-8500-42e2-8dfc-457a40486bd6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] HTTP exception thrown: Instance ead585f3-8422-41d8-9a7e-babd902216ea could not be found. May 26 16:53:26.034269 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6f398a84-8500-42e2-8dfc-457a40486bd6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Request method failure captured: May 26 16:53:26.034269 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea HTTP/1.1 May 26 16:53:26.034269 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept: application/json May 26 16:53:26.034269 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity May 26 16:53:26.034269 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Connection: close May 26 16:53:26.034269 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Length: 0 May 26 16:53:26.034269 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Type: application/json May 26 16:53:26.034269 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Host: 10.222.0.102 May 26 16:53:26.034269 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None May 26 16:53:26.034269 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 May 26 16:53:26.034269 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABij62ls_QXS8BetfnOiLi3iYdBIzuec_Y4yQ_t8KHJ0A0xyCzG_LOLOt-5f5-V8dnJXpYMtB5srQ1zeCtk_mtqtfxFPdfkmymvPMVpsQVd4u1aa-TIjNfqB4QVQu2wpl1jv5k2K6iYwvEhBfjgKxT3Oo8EipT3zl3l-LIsxMEY5W36dlM May 26 16:53:26.034269 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Id: None May 26 16:53:26.034269 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Name: None May 26 16:53:26.034269 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed May 26 16:53:26.034269 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True May 26 16:53:26.034269 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Openstack-Nova-Api-Version: 2.20 May 26 16:53:26.034269 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default May 26 16:53:26.034269 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default May 26 16:53:26.034269 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Id: a69cba8eb64f4fcc87bbc6960a0abeb0 May 26 16:53:26.034269 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-465880155 May 26 16:53:26.034269 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Role: reader,member May 26 16:53:26.034269 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Roles: reader,member May 26 16:53:26.035931 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/a69cba8eb64f4fcc87bbc6960a0abeb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/a69cba8eb64f4fcc87bbc6960a0abeb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/a69cba8eb64f4fcc87bbc6960a0abeb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_a69cba8eb64f4fcc87bbc6960a0abeb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:53:26.035931 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-AttachVolumeShelveTestJSON-465880155 May 26 16:53:26.035931 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Id: a69cba8eb64f4fcc87bbc6960a0abeb0 May 26 16:53:26.035931 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-465880155 May 26 16:53:26.035931 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User: tempest-AttachVolumeShelveTestJSON-465880155-project May 26 16:53:26.035931 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default May 26 16:53:26.035931 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default May 26 16:53:26.035931 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Id: e4941664ae624d4190ff53e5965db33f May 26 16:53:26.035931 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-AttachVolumeShelveTestJSON-465880155-project May 26 16:53:26.035931 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: method: > May 26 16:53:26.035931 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: exception: Instance ead585f3-8422-41d8-9a7e-babd902216ea could not be found. May 26 16:53:26.035931 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: action_args: {'id': 'ead585f3-8422-41d8-9a7e-babd902216ea'} May 26 16:53:26.036792 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:53:26.036792 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:26.036792 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:53:26.036792 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:53:26.036792 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:53:26.036792 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:53:26.036792 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:53:26.036792 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:53:26.036792 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:53:26.036792 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:53:26.036792 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ead585f3-8422-41d8-9a7e-babd902216ea could not be found. May 26 16:53:26.036792 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:53:26.036792 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:53:26.036792 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:53:26.036792 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:26.036792 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:53:26.036792 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:53:26.036792 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:53:26.036792 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:53:26.036792 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:53:26.038052 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:53:26.038052 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 16:53:26.038052 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 16:53:26.038052 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:53:26.038052 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:53:26.038052 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:53:26.038052 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:53:26.038052 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ead585f3-8422-41d8-9a7e-babd902216ea could not be found. May 26 16:53:26.038052 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:53:26.038052 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:53:26.038052 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:53:26.038052 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:26.038052 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:53:26.038052 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:53:26.038052 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:53:26.038052 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:53:26.038052 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ead585f3-8422-41d8-9a7e-babd902216ea could not be found. May 26 16:53:26.038052 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:53:26.039176 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6f398a84-8500-42e2-8dfc-457a40486bd6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Returning 404 to user: Instance ead585f3-8422-41d8-9a7e-babd902216ea could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:53:26.039176 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6f398a84-8500-42e2-8dfc-457a40486bd6 tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea" status: 404 len: 111 microversion: 2.20 time: 0.030432 May 26 16:53:26.039176 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 498/990] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:53:26 2022] GET /compute/v2.1/servers/ead585f3-8422-41d8-9a7e-babd902216ea => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 26 16:53:27.171367 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-dfd3a081-6f5c-4cdd-be54-1434729b0abb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:27.172172 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-dfd3a081-6f5c-4cdd-be54-1434729b0abb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:27.179227 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-dfd3a081-6f5c-4cdd-be54-1434729b0abb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:27.179749 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-dfd3a081-6f5c-4cdd-be54-1434729b0abb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:27.180542 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-dfd3a081-6f5c-4cdd-be54-1434729b0abb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:27.181100 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-dfd3a081-6f5c-4cdd-be54-1434729b0abb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:27.197537 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.wsgi [None req-dfd3a081-6f5c-4cdd-be54-1434729b0abb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] HTTP exception thrown: Instance a636d450-9d10-45a5-9982-9e10393fc4a9 could not be found. May 26 16:53:27.199070 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-dfd3a081-6f5c-4cdd-be54-1434729b0abb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Request method failure captured: May 26 16:53:27.199070 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: request: DELETE /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 HTTP/1.1 May 26 16:53:27.199070 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept: application/json May 26 16:53:27.199070 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept-Encoding: identity May 26 16:53:27.199070 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Connection: close May 26 16:53:27.199070 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Length: 0 May 26 16:53:27.199070 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Type: application/json May 26 16:53:27.199070 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Host: 10.222.0.102 May 26 16:53:27.199070 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Openstack-System-Scope: None May 26 16:53:27.199070 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: User-Agent: python-urllib3/1.26.9 May 26 16:53:27.199070 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Auth-Token: gAAAAABij62ls_QXS8BetfnOiLi3iYdBIzuec_Y4yQ_t8KHJ0A0xyCzG_LOLOt-5f5-V8dnJXpYMtB5srQ1zeCtk_mtqtfxFPdfkmymvPMVpsQVd4u1aa-TIjNfqB4QVQu2wpl1jv5k2K6iYwvEhBfjgKxT3Oo8EipT3zl3l-LIsxMEY5W36dlM May 26 16:53:27.199070 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Id: None May 26 16:53:27.199070 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Name: None May 26 16:53:27.199070 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Identity-Status: Confirmed May 26 16:53:27.199070 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Is-Admin-Project: True May 26 16:53:27.199070 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Openstack-Nova-Api-Version: 2.20 May 26 16:53:27.199070 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Id: default May 26 16:53:27.199070 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Name: Default May 26 16:53:27.199070 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Id: a69cba8eb64f4fcc87bbc6960a0abeb0 May 26 16:53:27.199070 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-465880155 May 26 16:53:27.199070 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Role: reader,member May 26 16:53:27.199070 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Roles: reader,member May 26 16:53:27.200756 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/a69cba8eb64f4fcc87bbc6960a0abeb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/a69cba8eb64f4fcc87bbc6960a0abeb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/a69cba8eb64f4fcc87bbc6960a0abeb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_a69cba8eb64f4fcc87bbc6960a0abeb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:53:27.200756 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant: tempest-AttachVolumeShelveTestJSON-465880155 May 26 16:53:27.200756 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Id: a69cba8eb64f4fcc87bbc6960a0abeb0 May 26 16:53:27.200756 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-465880155 May 26 16:53:27.200756 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User: tempest-AttachVolumeShelveTestJSON-465880155-project May 26 16:53:27.200756 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Id: default May 26 16:53:27.200756 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Name: Default May 26 16:53:27.200756 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Id: e4941664ae624d4190ff53e5965db33f May 26 16:53:27.200756 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Name: tempest-AttachVolumeShelveTestJSON-465880155-project May 26 16:53:27.200756 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: method: > May 26 16:53:27.200756 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: exception: Instance a636d450-9d10-45a5-9982-9e10393fc4a9 could not be found. May 26 16:53:27.200756 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: action_args: {'id': 'a636d450-9d10-45a5-9982-9e10393fc4a9'} May 26 16:53:27.201810 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:53:27.201810 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:27.201810 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:53:27.201810 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:53:27.201810 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:53:27.201810 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:53:27.201810 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:53:27.201810 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:53:27.201810 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:53:27.201810 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:53:27.201810 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a636d450-9d10-45a5-9982-9e10393fc4a9 could not be found. May 26 16:53:27.201810 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:53:27.201810 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:53:27.201810 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:53:27.201810 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:27.201810 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:53:27.201810 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:53:27.201810 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:53:27.201810 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:53:27.201810 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:53:27.203294 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:53:27.203294 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 16:53:27.203294 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 16:53:27.203294 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 16:53:27.203294 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 16:53:27.203294 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:53:27.203294 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:53:27.203294 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:53:27.203294 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:53:27.203294 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a636d450-9d10-45a5-9982-9e10393fc4a9 could not be found. May 26 16:53:27.203294 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:53:27.203294 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:53:27.203294 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:53:27.203294 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:27.203294 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:53:27.203294 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:53:27.203294 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:53:27.203294 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:53:27.203294 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a636d450-9d10-45a5-9982-9e10393fc4a9 could not be found. May 26 16:53:27.203294 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:53:27.204907 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-dfd3a081-6f5c-4cdd-be54-1434729b0abb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Returning 404 to user: Instance a636d450-9d10-45a5-9982-9e10393fc4a9 could not be found. {{(pid=124267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:53:27.204907 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-dfd3a081-6f5c-4cdd-be54-1434729b0abb tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "DELETE /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 404 len: 111 microversion: 2.20 time: 0.033047 May 26 16:53:27.204907 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 493/991] 10.222.0.102 () {60 vars in 1284 bytes} [Thu May 26 16:53:27 2022] DELETE /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 16:53:27.209028 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6e85ff8d-0652-49c8-9cce-4048ae2c4ecd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:27.209697 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-6e85ff8d-0652-49c8-9cce-4048ae2c4ecd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] [instance: a636d450-9d10-45a5-9982-9e10393fc4a9] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:27.216197 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6e85ff8d-0652-49c8-9cce-4048ae2c4ecd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:27.216673 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6e85ff8d-0652-49c8-9cce-4048ae2c4ecd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:27.217431 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6e85ff8d-0652-49c8-9cce-4048ae2c4ecd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:27.217863 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6e85ff8d-0652-49c8-9cce-4048ae2c4ecd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:27.231234 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-6e85ff8d-0652-49c8-9cce-4048ae2c4ecd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] HTTP exception thrown: Instance a636d450-9d10-45a5-9982-9e10393fc4a9 could not be found. May 26 16:53:27.232779 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6e85ff8d-0652-49c8-9cce-4048ae2c4ecd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Request method failure captured: May 26 16:53:27.232779 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 HTTP/1.1 May 26 16:53:27.232779 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept: application/json May 26 16:53:27.232779 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity May 26 16:53:27.232779 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Connection: close May 26 16:53:27.232779 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Length: 0 May 26 16:53:27.232779 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Type: application/json May 26 16:53:27.232779 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Host: 10.222.0.102 May 26 16:53:27.232779 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None May 26 16:53:27.232779 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 May 26 16:53:27.232779 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABij62ls_QXS8BetfnOiLi3iYdBIzuec_Y4yQ_t8KHJ0A0xyCzG_LOLOt-5f5-V8dnJXpYMtB5srQ1zeCtk_mtqtfxFPdfkmymvPMVpsQVd4u1aa-TIjNfqB4QVQu2wpl1jv5k2K6iYwvEhBfjgKxT3Oo8EipT3zl3l-LIsxMEY5W36dlM May 26 16:53:27.232779 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Id: None May 26 16:53:27.232779 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Name: None May 26 16:53:27.232779 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed May 26 16:53:27.232779 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True May 26 16:53:27.232779 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Openstack-Nova-Api-Version: 2.20 May 26 16:53:27.232779 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default May 26 16:53:27.232779 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default May 26 16:53:27.232779 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Id: a69cba8eb64f4fcc87bbc6960a0abeb0 May 26 16:53:27.232779 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-465880155 May 26 16:53:27.232779 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Role: reader,member May 26 16:53:27.232779 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Roles: reader,member May 26 16:53:27.234433 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/a69cba8eb64f4fcc87bbc6960a0abeb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/a69cba8eb64f4fcc87bbc6960a0abeb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/a69cba8eb64f4fcc87bbc6960a0abeb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_a69cba8eb64f4fcc87bbc6960a0abeb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:53:27.234433 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-AttachVolumeShelveTestJSON-465880155 May 26 16:53:27.234433 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Id: a69cba8eb64f4fcc87bbc6960a0abeb0 May 26 16:53:27.234433 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-465880155 May 26 16:53:27.234433 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User: tempest-AttachVolumeShelveTestJSON-465880155-project May 26 16:53:27.234433 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default May 26 16:53:27.234433 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default May 26 16:53:27.234433 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Id: e4941664ae624d4190ff53e5965db33f May 26 16:53:27.234433 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-AttachVolumeShelveTestJSON-465880155-project May 26 16:53:27.234433 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: method: > May 26 16:53:27.234433 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: exception: Instance a636d450-9d10-45a5-9982-9e10393fc4a9 could not be found. May 26 16:53:27.234433 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: action_args: {'id': 'a636d450-9d10-45a5-9982-9e10393fc4a9'} May 26 16:53:27.235363 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:53:27.235363 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:27.235363 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:53:27.235363 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:53:27.235363 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:53:27.235363 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:53:27.235363 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:53:27.235363 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:53:27.235363 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:53:27.235363 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:53:27.235363 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a636d450-9d10-45a5-9982-9e10393fc4a9 could not be found. May 26 16:53:27.235363 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:53:27.235363 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:53:27.235363 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:53:27.235363 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:27.235363 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:53:27.235363 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:53:27.235363 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:53:27.235363 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:53:27.235363 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:53:27.236949 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:53:27.236949 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 16:53:27.236949 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 16:53:27.236949 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:53:27.236949 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:53:27.236949 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:53:27.236949 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:53:27.236949 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a636d450-9d10-45a5-9982-9e10393fc4a9 could not be found. May 26 16:53:27.236949 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:53:27.236949 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:53:27.236949 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:53:27.236949 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:27.236949 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:53:27.236949 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:53:27.236949 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:53:27.236949 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:53:27.236949 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a636d450-9d10-45a5-9982-9e10393fc4a9 could not be found. May 26 16:53:27.236949 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:53:27.238243 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6e85ff8d-0652-49c8-9cce-4048ae2c4ecd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] Returning 404 to user: Instance a636d450-9d10-45a5-9982-9e10393fc4a9 could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:53:27.238243 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6e85ff8d-0652-49c8-9cce-4048ae2c4ecd tempest-AttachVolumeShelveTestJSON-465880155 tempest-AttachVolumeShelveTestJSON-465880155-project] 10.222.0.102 "GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9" status: 404 len: 111 microversion: 2.20 time: 0.028967 May 26 16:53:27.238243 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 499/992] 10.222.0.102 () {60 vars in 1281 bytes} [Thu May 26 16:53:27 2022] GET /compute/v2.1/servers/a636d450-9d10-45a5-9982-9e10393fc4a9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 16:53:39.119022 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-d3c68810-2c30-4d4a-80b0-9e64c18e8ee8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:39.119719 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-d3c68810-2c30-4d4a-80b0-9e64c18e8ee8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 66738af8-23b3-415c-8352-519823df5647] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:39.122571 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_api:SELECT=12 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:39.123290 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=24 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:39.129475 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d3c68810-2c30-4d4a-80b0-9e64c18e8ee8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:39.130112 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d3c68810-2c30-4d4a-80b0-9e64c18e8ee8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:39.130948 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d3c68810-2c30-4d4a-80b0-9e64c18e8ee8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:39.131438 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d3c68810-2c30-4d4a-80b0-9e64c18e8ee8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:39.160040 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-d3c68810-2c30-4d4a-80b0-9e64c18e8ee8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 66738af8-23b3-415c-8352-519823df5647] Going to try to terminate instance {{(pid=124267) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 16:53:39.236994 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-d3c68810-2c30-4d4a-80b0-9e64c18e8ee8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "DELETE /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647" status: 204 len: 0 microversion: 2.1 time: 0.122697 May 26 16:53:39.237641 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 494/993] 10.222.0.102 () {58 vars in 1243 bytes} [Thu May 26 16:53:39 2022] DELETE /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 16:53:39.246069 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a6189389-6ea7-435c-a4e0-a39413f867e7 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:39.246689 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a6189389-6ea7-435c-a4e0-a39413f867e7 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 66738af8-23b3-415c-8352-519823df5647] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:39.249396 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:39.250063 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:39.257346 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a6189389-6ea7-435c-a4e0-a39413f867e7 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:39.257865 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a6189389-6ea7-435c-a4e0-a39413f867e7 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:39.258762 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a6189389-6ea7-435c-a4e0-a39413f867e7 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:39.259394 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a6189389-6ea7-435c-a4e0-a39413f867e7 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:39.398573 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-a6189389-6ea7-435c-a4e0-a39413f867e7 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:39.406358 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a6189389-6ea7-435c-a4e0-a39413f867e7 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647" status: 200 len: 1580 microversion: 2.1 time: 0.164244 May 26 16:53:39.406938 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 500/994] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:53:39 2022] GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647 => generated 1580 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:53:40.425642 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-63c62b05-3d33-48b9-ad09-21a0b1b43ed9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:40.426355 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-63c62b05-3d33-48b9-ad09-21a0b1b43ed9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 66738af8-23b3-415c-8352-519823df5647] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:40.434435 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-63c62b05-3d33-48b9-ad09-21a0b1b43ed9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:40.434909 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-63c62b05-3d33-48b9-ad09-21a0b1b43ed9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:40.435909 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-63c62b05-3d33-48b9-ad09-21a0b1b43ed9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:40.436414 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-63c62b05-3d33-48b9-ad09-21a0b1b43ed9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:40.594527 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-63c62b05-3d33-48b9-ad09-21a0b1b43ed9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:40.603262 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-63c62b05-3d33-48b9-ad09-21a0b1b43ed9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647" status: 200 len: 1580 microversion: 2.1 time: 0.182342 May 26 16:53:40.603968 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 495/995] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:53:40 2022] GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647 => generated 1580 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:41.621226 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-628cc71a-bf0d-4e4f-a2f3-4a6895b71ca2 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:41.621852 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-628cc71a-bf0d-4e4f-a2f3-4a6895b71ca2 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 66738af8-23b3-415c-8352-519823df5647] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:41.629204 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-628cc71a-bf0d-4e4f-a2f3-4a6895b71ca2 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:41.629657 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-628cc71a-bf0d-4e4f-a2f3-4a6895b71ca2 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:41.630446 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-628cc71a-bf0d-4e4f-a2f3-4a6895b71ca2 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:41.630883 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-628cc71a-bf0d-4e4f-a2f3-4a6895b71ca2 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:41.776762 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-628cc71a-bf0d-4e4f-a2f3-4a6895b71ca2 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:41.784754 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-628cc71a-bf0d-4e4f-a2f3-4a6895b71ca2 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647" status: 200 len: 1580 microversion: 2.1 time: 0.167587 May 26 16:53:41.785340 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 501/996] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:53:41 2022] GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647 => generated 1580 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:42.803105 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-ba276113-8aa5-4f65-be32-4ccfdcf73aeb tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:42.804635 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-ba276113-8aa5-4f65-be32-4ccfdcf73aeb tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 66738af8-23b3-415c-8352-519823df5647] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:42.812955 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ba276113-8aa5-4f65-be32-4ccfdcf73aeb tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:42.813693 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ba276113-8aa5-4f65-be32-4ccfdcf73aeb tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:42.814709 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ba276113-8aa5-4f65-be32-4ccfdcf73aeb tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:42.815509 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ba276113-8aa5-4f65-be32-4ccfdcf73aeb tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:42.955131 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-ba276113-8aa5-4f65-be32-4ccfdcf73aeb tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:42.968926 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-ba276113-8aa5-4f65-be32-4ccfdcf73aeb tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647" status: 200 len: 1580 microversion: 2.1 time: 0.170877 May 26 16:53:42.969520 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 496/997] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:53:42 2022] GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647 => generated 1580 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:43.249560 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-8b616787-bdc4-4922-aa70-5f8fff033801 req-67263ca2-36f2-495b-a0e9-3cdf5d487028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66738af8-23b3-415c-8352-519823df5647", "name": "network-vif-deleted", "tag": "126beea4-9563-4685-91f9-9c5c1283a96b"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:53:43.258612 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-8b616787-bdc4-4922-aa70-5f8fff033801 req-67263ca2-36f2-495b-a0e9-3cdf5d487028 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:43.259053 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-8b616787-bdc4-4922-aa70-5f8fff033801 req-67263ca2-36f2-495b-a0e9-3cdf5d487028 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:43.270471 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-8b616787-bdc4-4922-aa70-5f8fff033801 req-67263ca2-36f2-495b-a0e9-3cdf5d487028 service nova] Creating event network-vif-deleted:126beea4-9563-4685-91f9-9c5c1283a96b for instance 66738af8-23b3-415c-8352-519823df5647 on hv-cinder-83607 May 26 16:53:43.279145 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-8b616787-bdc4-4922-aa70-5f8fff033801 req-67263ca2-36f2-495b-a0e9-3cdf5d487028 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033488 May 26 16:53:43.280077 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 502/998] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:53:43.989920 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-9e001a10-3aef-4dd2-bb52-a16ca061cd74 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:43.990693 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-9e001a10-3aef-4dd2-bb52-a16ca061cd74 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 66738af8-23b3-415c-8352-519823df5647] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:43.998250 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9e001a10-3aef-4dd2-bb52-a16ca061cd74 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:43.999100 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9e001a10-3aef-4dd2-bb52-a16ca061cd74 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:44.011992 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9e001a10-3aef-4dd2-bb52-a16ca061cd74 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:44.013076 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9e001a10-3aef-4dd2-bb52-a16ca061cd74 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:44.051658 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9e001a10-3aef-4dd2-bb52-a16ca061cd74 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:44.052130 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9e001a10-3aef-4dd2-bb52-a16ca061cd74 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:44.052714 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.objects.instance [None req-9e001a10-3aef-4dd2-bb52-a16ca061cd74 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lazy-loading 'fault' on Instance uuid 66738af8-23b3-415c-8352-519823df5647 {{(pid=124267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:53:44.107707 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-9e001a10-3aef-4dd2-bb52-a16ca061cd74 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:44.118158 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-9e001a10-3aef-4dd2-bb52-a16ca061cd74 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647" status: 200 len: 1233 microversion: 2.1 time: 0.135999 May 26 16:53:44.118962 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 497/999] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:53:43 2022] GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647 => generated 1233 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:45.147833 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9d0d7d1e-0b82-43f7-8fde-4c46f3ccf6ec tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:45.148658 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9d0d7d1e-0b82-43f7-8fde-4c46f3ccf6ec tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 66738af8-23b3-415c-8352-519823df5647] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:45.155756 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9d0d7d1e-0b82-43f7-8fde-4c46f3ccf6ec tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:45.156285 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9d0d7d1e-0b82-43f7-8fde-4c46f3ccf6ec tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:45.157175 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9d0d7d1e-0b82-43f7-8fde-4c46f3ccf6ec tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:45.157692 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9d0d7d1e-0b82-43f7-8fde-4c46f3ccf6ec tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:45.171900 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-9d0d7d1e-0b82-43f7-8fde-4c46f3ccf6ec tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] HTTP exception thrown: Instance 66738af8-23b3-415c-8352-519823df5647 could not be found. May 26 16:53:45.173569 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9d0d7d1e-0b82-43f7-8fde-4c46f3ccf6ec tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Request method failure captured: May 26 16:53:45.173569 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647 HTTP/1.1 May 26 16:53:45.173569 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept: application/json May 26 16:53:45.173569 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity May 26 16:53:45.173569 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Connection: close May 26 16:53:45.173569 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Length: 0 May 26 16:53:45.173569 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Type: application/json May 26 16:53:45.173569 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Host: 10.222.0.102 May 26 16:53:45.173569 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None May 26 16:53:45.173569 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 May 26 16:53:45.173569 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABij6-bCnz1krl3jvaMy3xBF_gVub4hyPORFSK_UZUqjMUnGopA_9vnLUGx7868E9wmXQ1i5XTbb8Ln3FLxLb13_-qyF56oOXfxAmPwNOJGO8o7u7A9EhqvrJzh-ml-alqWaq98EV8cXVkUt9_F5g-U7YzkZgUh57FsEKUyPEyHuepAcPU May 26 16:53:45.173569 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Id: None May 26 16:53:45.173569 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Name: None May 26 16:53:45.173569 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed May 26 16:53:45.173569 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True May 26 16:53:45.173569 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default May 26 16:53:45.173569 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default May 26 16:53:45.173569 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Id: 257f08cba99b478db51729bf108ec901 May 26 16:53:45.173569 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-TestVolumeBootPattern-2097601180 May 26 16:53:45.173569 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Role: reader,member May 26 16:53:45.173569 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Roles: reader,member May 26 16:53:45.175089 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/257f08cba99b478db51729bf108ec901"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/257f08cba99b478db51729bf108ec901"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/257f08cba99b478db51729bf108ec901"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_257f08cba99b478db51729bf108ec901"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:53:45.175089 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-TestVolumeBootPattern-2097601180 May 26 16:53:45.175089 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Id: 257f08cba99b478db51729bf108ec901 May 26 16:53:45.175089 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-TestVolumeBootPattern-2097601180 May 26 16:53:45.175089 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User: tempest-TestVolumeBootPattern-2097601180-project May 26 16:53:45.175089 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default May 26 16:53:45.175089 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default May 26 16:53:45.175089 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Id: 6f7a1fe832af4c83b4b969729d0721e9 May 26 16:53:45.175089 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-TestVolumeBootPattern-2097601180-project May 26 16:53:45.175089 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: method: > May 26 16:53:45.175089 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: exception: Instance 66738af8-23b3-415c-8352-519823df5647 could not be found. May 26 16:53:45.175089 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: action_args: {'id': '66738af8-23b3-415c-8352-519823df5647'} May 26 16:53:45.180567 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:53:45.180567 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:45.180567 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:53:45.180567 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:53:45.180567 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:53:45.180567 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:53:45.180567 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:53:45.180567 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:53:45.180567 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:53:45.180567 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:53:45.180567 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66738af8-23b3-415c-8352-519823df5647 could not be found. May 26 16:53:45.180567 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:53:45.180567 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:53:45.180567 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:53:45.180567 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:45.180567 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:53:45.180567 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:53:45.180567 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:53:45.180567 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:53:45.180567 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:53:45.182007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:53:45.182007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 16:53:45.182007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 16:53:45.182007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:53:45.182007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:53:45.182007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:53:45.182007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:53:45.182007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66738af8-23b3-415c-8352-519823df5647 could not be found. May 26 16:53:45.182007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:53:45.182007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:53:45.182007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:53:45.182007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:45.182007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:53:45.182007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:53:45.182007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:53:45.182007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:53:45.182007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66738af8-23b3-415c-8352-519823df5647 could not be found. May 26 16:53:45.182007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:53:45.183325 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9d0d7d1e-0b82-43f7-8fde-4c46f3ccf6ec tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Returning 404 to user: Instance 66738af8-23b3-415c-8352-519823df5647 could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:53:45.183325 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9d0d7d1e-0b82-43f7-8fde-4c46f3ccf6ec tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647" status: 404 len: 111 microversion: 2.1 time: 0.039652 May 26 16:53:45.183325 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 503/1000] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:53:45 2022] GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 16:53:45.279091 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-801d5700-3d73-407d-bb67-857892d7d099 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-947281402", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-902784053", "security_groups": [{"name": "tempest-secgroup-smoke-647515624"}], "block_device_mapping_v2": [{"uuid": "c882ddac-d0cb-4ae8-a4de-c21ce68dc22d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c1d12c9f-73ed-437d-b2a9-5cffbb8cbe3e"}]}} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:53:45.410744 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.network.neutron [None req-801d5700-3d73-407d-bb67-857892d7d099 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] validate_networks() for [('c1d12c9f-73ed-437d-b2a9-5cffbb8cbe3e', None, None, None, None, None)] {{(pid=124267) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:53:46.112926 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-801d5700-3d73-407d-bb67-857892d7d099 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Flavor limits 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:53:46.113406 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-801d5700-3d73-407d-bb67-857892d7d099 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Image limits 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:53:46.113891 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-801d5700-3d73-407d-bb67-857892d7d099 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Flavor pref 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:53:46.114305 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-801d5700-3d73-407d-bb67-857892d7d099 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Image pref 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:53:46.114755 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-801d5700-3d73-407d-bb67-857892d7d099 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:53:46.124068 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-801d5700-3d73-407d-bb67-857892d7d099 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:46.125026 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-801d5700-3d73-407d-bb67-857892d7d099 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:46.125872 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-801d5700-3d73-407d-bb67-857892d7d099 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:46.126307 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-801d5700-3d73-407d-bb67-857892d7d099 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:46.143647 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.quota [None req-801d5700-3d73-407d-bb67-857892d7d099 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Getting quotas for project 257f08cba99b478db51729bf108ec901. Resources: {'cores', 'instances', 'ram'} {{(pid=124267) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:53:46.148229 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.quota [None req-801d5700-3d73-407d-bb67-857892d7d099 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Getting quotas for user 6f7a1fe832af4c83b4b969729d0721e9 and project 257f08cba99b478db51729bf108ec901. Resources: {'cores', 'instances', 'ram'} {{(pid=124267) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:53:46.226166 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-801d5700-3d73-407d-bb67-857892d7d099 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Going to run 1 instances... {{(pid=124267) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:53:46.229674 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-801d5700-3d73-407d-bb67-857892d7d099 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 67dbd32c-21f9-48b2-b4b2-74f37cce2d82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c882ddac-d0cb-4ae8-a4de-c21ce68dc22d',volume_size=None,volume_type=None)] {{(pid=124267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:53:46.382894 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-801d5700-3d73-407d-bb67-857892d7d099 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.107255 May 26 16:53:46.388539 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 498/1001] 10.222.0.102 () {60 vars in 1151 bytes} [Thu May 26 16:53:45 2022] POST /compute/v2.1/servers => generated 407 bytes in 1109 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 16:53:46.393172 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-5a394873-1ebe-481f-838a-59838be4f05f tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:46.393782 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-5a394873-1ebe-481f-838a-59838be4f05f tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 67dbd32c-21f9-48b2-b4b2-74f37cce2d82] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:46.457422 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-5a394873-1ebe-481f-838a-59838be4f05f tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:46.468758 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-5a394873-1ebe-481f-838a-59838be4f05f tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82" status: 200 len: 1096 microversion: 2.1 time: 0.079264 May 26 16:53:46.469338 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 504/1002] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:53:46 2022] GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82 => generated 1096 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:53:47.486699 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-d515c8e9-4ec4-4af9-a75b-f83456327f55 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:47.488052 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-d515c8e9-4ec4-4af9-a75b-f83456327f55 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 67dbd32c-21f9-48b2-b4b2-74f37cce2d82] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:47.497406 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d515c8e9-4ec4-4af9-a75b-f83456327f55 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:47.498327 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d515c8e9-4ec4-4af9-a75b-f83456327f55 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:47.499411 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d515c8e9-4ec4-4af9-a75b-f83456327f55 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:47.500405 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d515c8e9-4ec4-4af9-a75b-f83456327f55 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:47.569703 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-d515c8e9-4ec4-4af9-a75b-f83456327f55 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:47.577688 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-d515c8e9-4ec4-4af9-a75b-f83456327f55 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82" status: 200 len: 1212 microversion: 2.1 time: 0.095522 May 26 16:53:47.578607 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 499/1003] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:53:47 2022] GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82 => generated 1212 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:48.602727 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-1cc884bc-983d-4739-8ede-817f30c40516 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:48.604951 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-1cc884bc-983d-4739-8ede-817f30c40516 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 67dbd32c-21f9-48b2-b4b2-74f37cce2d82] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:48.627494 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1cc884bc-983d-4739-8ede-817f30c40516 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:48.628329 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1cc884bc-983d-4739-8ede-817f30c40516 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:48.629964 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1cc884bc-983d-4739-8ede-817f30c40516 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:48.631428 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-1cc884bc-983d-4739-8ede-817f30c40516 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:48.890971 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-1cc884bc-983d-4739-8ede-817f30c40516 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:48.905561 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-1cc884bc-983d-4739-8ede-817f30c40516 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82" status: 200 len: 1267 microversion: 2.1 time: 0.313480 May 26 16:53:48.906668 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 505/1004] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:53:48 2022] GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82 => generated 1267 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:49.358258 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-15d4ff99-64f2-4c06-bc12-ca84fda8ce7f req-6b4976b3-2f9f-4fcf-9344-071f36d3eef5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67dbd32c-21f9-48b2-b4b2-74f37cce2d82", "tag": "8b3af3df-2524-4785-8ea4-ef0b84e6d32e"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:53:49.391652 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-15d4ff99-64f2-4c06-bc12-ca84fda8ce7f req-6b4976b3-2f9f-4fcf-9344-071f36d3eef5 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:49.392104 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-15d4ff99-64f2-4c06-bc12-ca84fda8ce7f req-6b4976b3-2f9f-4fcf-9344-071f36d3eef5 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:49.410690 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-15d4ff99-64f2-4c06-bc12-ca84fda8ce7f req-6b4976b3-2f9f-4fcf-9344-071f36d3eef5 service nova] Creating event network-changed:8b3af3df-2524-4785-8ea4-ef0b84e6d32e for instance 67dbd32c-21f9-48b2-b4b2-74f37cce2d82 on hv-cinder-83607 May 26 16:53:49.416329 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-15d4ff99-64f2-4c06-bc12-ca84fda8ce7f req-6b4976b3-2f9f-4fcf-9344-071f36d3eef5 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070628 May 26 16:53:49.417851 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 500/1005] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:53:49.924169 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0015080c-3443-457c-b40c-2271eb39736f tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:49.924805 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0015080c-3443-457c-b40c-2271eb39736f tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 67dbd32c-21f9-48b2-b4b2-74f37cce2d82] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:49.931925 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0015080c-3443-457c-b40c-2271eb39736f tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:49.932418 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0015080c-3443-457c-b40c-2271eb39736f tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:49.933206 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0015080c-3443-457c-b40c-2271eb39736f tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:49.933646 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0015080c-3443-457c-b40c-2271eb39736f tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:50.085972 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0015080c-3443-457c-b40c-2271eb39736f tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:50.094599 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0015080c-3443-457c-b40c-2271eb39736f tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82" status: 200 len: 1267 microversion: 2.1 time: 0.174396 May 26 16:53:50.095518 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 506/1006] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:53:49 2022] GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:53:51.113359 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-19a84cf5-a96c-43f1-9b7c-45f16b3b19b3 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:51.114255 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-19a84cf5-a96c-43f1-9b7c-45f16b3b19b3 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 67dbd32c-21f9-48b2-b4b2-74f37cce2d82] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:51.121671 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-19a84cf5-a96c-43f1-9b7c-45f16b3b19b3 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:51.122130 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-19a84cf5-a96c-43f1-9b7c-45f16b3b19b3 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:51.122922 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-19a84cf5-a96c-43f1-9b7c-45f16b3b19b3 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:51.123363 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-19a84cf5-a96c-43f1-9b7c-45f16b3b19b3 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:51.273009 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-19a84cf5-a96c-43f1-9b7c-45f16b3b19b3 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:51.281496 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-19a84cf5-a96c-43f1-9b7c-45f16b3b19b3 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82" status: 200 len: 1267 microversion: 2.1 time: 0.173150 May 26 16:53:51.282090 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 501/1007] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:53:51 2022] GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:52.298815 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-13c7c528-cbe0-42ae-89a0-1111d424ef65 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:52.299426 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-13c7c528-cbe0-42ae-89a0-1111d424ef65 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 67dbd32c-21f9-48b2-b4b2-74f37cce2d82] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:52.305883 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-13c7c528-cbe0-42ae-89a0-1111d424ef65 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:52.306339 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-13c7c528-cbe0-42ae-89a0-1111d424ef65 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:52.307088 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-13c7c528-cbe0-42ae-89a0-1111d424ef65 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:52.307521 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-13c7c528-cbe0-42ae-89a0-1111d424ef65 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:52.438068 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-13c7c528-cbe0-42ae-89a0-1111d424ef65 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:52.446160 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-13c7c528-cbe0-42ae-89a0-1111d424ef65 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82" status: 200 len: 1267 microversion: 2.1 time: 0.151205 May 26 16:53:52.446726 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 507/1008] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:53:52 2022] GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:53.463517 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-0f67c560-9b3d-4404-9baf-d20733193077 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:53.464106 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-0f67c560-9b3d-4404-9baf-d20733193077 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 67dbd32c-21f9-48b2-b4b2-74f37cce2d82] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:53.470643 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0f67c560-9b3d-4404-9baf-d20733193077 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:53.471089 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0f67c560-9b3d-4404-9baf-d20733193077 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:53.471856 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0f67c560-9b3d-4404-9baf-d20733193077 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:53.472295 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-0f67c560-9b3d-4404-9baf-d20733193077 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:53.621680 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-0f67c560-9b3d-4404-9baf-d20733193077 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:53.629433 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-0f67c560-9b3d-4404-9baf-d20733193077 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82" status: 200 len: 1267 microversion: 2.1 time: 0.169947 May 26 16:53:53.630010 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 502/1009] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:53:53 2022] GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:54.647020 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-160da0a4-cd46-47a4-ac44-b7b886928c62 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:54.647700 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-160da0a4-cd46-47a4-ac44-b7b886928c62 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 67dbd32c-21f9-48b2-b4b2-74f37cce2d82] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:54.654557 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-160da0a4-cd46-47a4-ac44-b7b886928c62 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:54.654995 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-160da0a4-cd46-47a4-ac44-b7b886928c62 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:54.655803 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-160da0a4-cd46-47a4-ac44-b7b886928c62 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:54.656236 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-160da0a4-cd46-47a4-ac44-b7b886928c62 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:54.794098 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-160da0a4-cd46-47a4-ac44-b7b886928c62 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:54.803334 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-160da0a4-cd46-47a4-ac44-b7b886928c62 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82" status: 200 len: 1267 microversion: 2.1 time: 0.160040 May 26 16:53:54.803921 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 508/1010] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:53:54 2022] GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:55.821100 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-dd05215e-7be5-4166-9d28-3eca95725026 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:55.821686 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-dd05215e-7be5-4166-9d28-3eca95725026 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 67dbd32c-21f9-48b2-b4b2-74f37cce2d82] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:55.828926 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-dd05215e-7be5-4166-9d28-3eca95725026 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:55.829307 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-dd05215e-7be5-4166-9d28-3eca95725026 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:55.830108 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-dd05215e-7be5-4166-9d28-3eca95725026 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:55.830552 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-dd05215e-7be5-4166-9d28-3eca95725026 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:55.994644 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-dd05215e-7be5-4166-9d28-3eca95725026 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:56.004223 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-dd05215e-7be5-4166-9d28-3eca95725026 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82" status: 200 len: 1267 microversion: 2.1 time: 0.186464 May 26 16:53:56.006008 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 503/1011] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:53:55 2022] GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82 => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:57.022272 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-053328e1-38e5-4a65-ba13-920fa1f9c205 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:57.022828 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-053328e1-38e5-4a65-ba13-920fa1f9c205 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 67dbd32c-21f9-48b2-b4b2-74f37cce2d82] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:57.025275 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:57.031184 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-053328e1-38e5-4a65-ba13-920fa1f9c205 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:57.031663 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-053328e1-38e5-4a65-ba13-920fa1f9c205 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:57.032475 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-053328e1-38e5-4a65-ba13-920fa1f9c205 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:57.032907 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-053328e1-38e5-4a65-ba13-920fa1f9c205 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:57.185052 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-053328e1-38e5-4a65-ba13-920fa1f9c205 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:57.194413 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-053328e1-38e5-4a65-ba13-920fa1f9c205 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82" status: 200 len: 1267 microversion: 2.1 time: 0.176791 May 26 16:53:57.195213 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 509/1012] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:53:57 2022] GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:58.213776 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-e54ea37b-5675-4293-9c01-cdd30beaef8e tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:58.214395 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-e54ea37b-5675-4293-9c01-cdd30beaef8e tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 67dbd32c-21f9-48b2-b4b2-74f37cce2d82] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:58.216335 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell0:SELECT=2 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:58.217050 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell0:SELECT=6 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:58.223854 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e54ea37b-5675-4293-9c01-cdd30beaef8e tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:58.224853 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e54ea37b-5675-4293-9c01-cdd30beaef8e tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:58.225625 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e54ea37b-5675-4293-9c01-cdd30beaef8e tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:58.226065 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e54ea37b-5675-4293-9c01-cdd30beaef8e tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:58.361008 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-e54ea37b-5675-4293-9c01-cdd30beaef8e tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:58.369261 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-e54ea37b-5675-4293-9c01-cdd30beaef8e tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82" status: 200 len: 1267 microversion: 2.1 time: 0.159407 May 26 16:53:58.369841 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 504/1013] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:53:58 2022] GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:59.388900 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-5d4b6071-2308-41a3-b8fe-fcc0fadc6c11 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:59.389534 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-5d4b6071-2308-41a3-b8fe-fcc0fadc6c11 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 67dbd32c-21f9-48b2-b4b2-74f37cce2d82] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:59.396049 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5d4b6071-2308-41a3-b8fe-fcc0fadc6c11 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:59.396544 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5d4b6071-2308-41a3-b8fe-fcc0fadc6c11 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:59.397315 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5d4b6071-2308-41a3-b8fe-fcc0fadc6c11 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:59.397754 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5d4b6071-2308-41a3-b8fe-fcc0fadc6c11 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:59.533738 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-5d4b6071-2308-41a3-b8fe-fcc0fadc6c11 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:59.541490 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-5d4b6071-2308-41a3-b8fe-fcc0fadc6c11 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82" status: 200 len: 1267 microversion: 2.1 time: 0.156460 May 26 16:53:59.542076 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 510/1014] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:53:59 2022] GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:00.558725 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-bd796cee-3336-4ea0-8626-ffb3d4941fbc tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:00.559360 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-bd796cee-3336-4ea0-8626-ffb3d4941fbc tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 67dbd32c-21f9-48b2-b4b2-74f37cce2d82] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:00.566356 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bd796cee-3336-4ea0-8626-ffb3d4941fbc tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:00.566719 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bd796cee-3336-4ea0-8626-ffb3d4941fbc tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:00.567560 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bd796cee-3336-4ea0-8626-ffb3d4941fbc tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:00.568564 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bd796cee-3336-4ea0-8626-ffb3d4941fbc tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:00.715027 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-bd796cee-3336-4ea0-8626-ffb3d4941fbc tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:00.723401 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-bd796cee-3336-4ea0-8626-ffb3d4941fbc tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82" status: 200 len: 1267 microversion: 2.1 time: 0.167983 May 26 16:54:00.723401 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 505/1015] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:54:00 2022] GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:01.146861 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-9d3138bc-8fe0-4395-bf5f-204b4de99430 req-1a0b6be1-5c38-4acf-8cfd-76af6722626f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67dbd32c-21f9-48b2-b4b2-74f37cce2d82", "name": "network-vif-plugged", "status": "completed", "tag": "8b3af3df-2524-4785-8ea4-ef0b84e6d32e"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:54:01.166933 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-9d3138bc-8fe0-4395-bf5f-204b4de99430 req-1a0b6be1-5c38-4acf-8cfd-76af6722626f service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:01.167992 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-9d3138bc-8fe0-4395-bf5f-204b4de99430 req-1a0b6be1-5c38-4acf-8cfd-76af6722626f service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:01.185331 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-9d3138bc-8fe0-4395-bf5f-204b4de99430 req-1a0b6be1-5c38-4acf-8cfd-76af6722626f service nova] Creating event network-vif-plugged:8b3af3df-2524-4785-8ea4-ef0b84e6d32e for instance 67dbd32c-21f9-48b2-b4b2-74f37cce2d82 on hv-cinder-83607 May 26 16:54:01.193760 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-9d3138bc-8fe0-4395-bf5f-204b4de99430 req-1a0b6be1-5c38-4acf-8cfd-76af6722626f service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054028 May 26 16:54:01.194892 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 511/1016] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:54:01.739164 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-3febf25c-eda4-4a14-ae41-5ec56f7e2d49 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:01.739833 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-3febf25c-eda4-4a14-ae41-5ec56f7e2d49 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 67dbd32c-21f9-48b2-b4b2-74f37cce2d82] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:01.746409 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3febf25c-eda4-4a14-ae41-5ec56f7e2d49 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:01.746869 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3febf25c-eda4-4a14-ae41-5ec56f7e2d49 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:01.747664 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3febf25c-eda4-4a14-ae41-5ec56f7e2d49 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:01.748107 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3febf25c-eda4-4a14-ae41-5ec56f7e2d49 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:01.946859 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-3febf25c-eda4-4a14-ae41-5ec56f7e2d49 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:01.954473 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-3febf25c-eda4-4a14-ae41-5ec56f7e2d49 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82" status: 200 len: 1267 microversion: 2.1 time: 0.219211 May 26 16:54:01.955060 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 506/1017] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:54:01 2022] GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82 => generated 1267 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:02.981219 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-c6668338-8619-4afb-8c9c-f3720d053585 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:02.983626 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-c6668338-8619-4afb-8c9c-f3720d053585 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 67dbd32c-21f9-48b2-b4b2-74f37cce2d82] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:02.992322 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c6668338-8619-4afb-8c9c-f3720d053585 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:02.993076 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c6668338-8619-4afb-8c9c-f3720d053585 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:02.994052 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c6668338-8619-4afb-8c9c-f3720d053585 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:02.995127 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-c6668338-8619-4afb-8c9c-f3720d053585 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:03.165117 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-c6668338-8619-4afb-8c9c-f3720d053585 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:03.173807 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-c6668338-8619-4afb-8c9c-f3720d053585 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82" status: 200 len: 1267 microversion: 2.1 time: 0.203641 May 26 16:54:03.174424 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 512/1018] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:54:02 2022] GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82 => generated 1267 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:04.194926 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-e2469c90-1488-4f05-8f3f-30e33aee38af tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:04.195530 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-e2469c90-1488-4f05-8f3f-30e33aee38af tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 67dbd32c-21f9-48b2-b4b2-74f37cce2d82] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:04.202425 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e2469c90-1488-4f05-8f3f-30e33aee38af tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:04.202878 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e2469c90-1488-4f05-8f3f-30e33aee38af tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:04.203653 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e2469c90-1488-4f05-8f3f-30e33aee38af tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:04.204087 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e2469c90-1488-4f05-8f3f-30e33aee38af tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:04.340351 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-e2469c90-1488-4f05-8f3f-30e33aee38af tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:04.348256 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-e2469c90-1488-4f05-8f3f-30e33aee38af tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82" status: 200 len: 1454 microversion: 2.1 time: 0.157743 May 26 16:54:04.348887 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 507/1019] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:54:04 2022] GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82 => generated 1454 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:04.364795 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-4fcf8fbe-43f8-4c51-ae95-75885ab68dd2 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:04.365499 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-4fcf8fbe-43f8-4c51-ae95-75885ab68dd2 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 67dbd32c-21f9-48b2-b4b2-74f37cce2d82] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:04.372100 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4fcf8fbe-43f8-4c51-ae95-75885ab68dd2 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:04.372593 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4fcf8fbe-43f8-4c51-ae95-75885ab68dd2 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:04.373383 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4fcf8fbe-43f8-4c51-ae95-75885ab68dd2 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:04.373826 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4fcf8fbe-43f8-4c51-ae95-75885ab68dd2 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:04.525451 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-4fcf8fbe-43f8-4c51-ae95-75885ab68dd2 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:04.533104 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-4fcf8fbe-43f8-4c51-ae95-75885ab68dd2 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82" status: 200 len: 1454 microversion: 2.1 time: 0.172064 May 26 16:54:04.533681 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 513/1020] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:54:04 2022] GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82 => generated 1454 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:06.410960 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-c74762ae-09b7-4d47-ad23-4305c2e184fa req-a8900ea3-a524-4ec7-b4a7-3027670b86ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67dbd32c-21f9-48b2-b4b2-74f37cce2d82", "tag": "8b3af3df-2524-4785-8ea4-ef0b84e6d32e"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:54:06.422435 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-c74762ae-09b7-4d47-ad23-4305c2e184fa req-a8900ea3-a524-4ec7-b4a7-3027670b86ff service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:06.422975 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-c74762ae-09b7-4d47-ad23-4305c2e184fa req-a8900ea3-a524-4ec7-b4a7-3027670b86ff service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:06.438212 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-c74762ae-09b7-4d47-ad23-4305c2e184fa req-a8900ea3-a524-4ec7-b4a7-3027670b86ff service nova] Creating event network-changed:8b3af3df-2524-4785-8ea4-ef0b84e6d32e for instance 67dbd32c-21f9-48b2-b4b2-74f37cce2d82 on hv-cinder-83607 May 26 16:54:06.443711 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-c74762ae-09b7-4d47-ad23-4305c2e184fa req-a8900ea3-a524-4ec7-b4a7-3027670b86ff service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174267 May 26 16:54:06.444335 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 508/1021] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:54:41.149333 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-329eec4d-9ae0-4346-9f7b-3930d3212d1f tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1967620410", "imageRef": "d74c4a51-21fe-41d5-865a-cb93604ac3aa", "flavorRef": "452", "networks": [{"uuid": "f4d338af-1652-45c0-bf27-5f27d7749e08"}]}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:54:41.156055 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=30 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:41.156710 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=66 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:41.202659 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.network.neutron [None req-329eec4d-9ae0-4346-9f7b-3930d3212d1f tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] validate_networks() for [('f4d338af-1652-45c0-bf27-5f27d7749e08', None, None, None, None, None)] {{(pid=124266) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:54:41.542846 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-329eec4d-9ae0-4346-9f7b-3930d3212d1f tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Flavor limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:54:41.543274 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-329eec4d-9ae0-4346-9f7b-3930d3212d1f tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Image limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:54:41.543749 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-329eec4d-9ae0-4346-9f7b-3930d3212d1f tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Flavor pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:54:41.544185 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-329eec4d-9ae0-4346-9f7b-3930d3212d1f tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Image pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:54:41.544627 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-329eec4d-9ae0-4346-9f7b-3930d3212d1f tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:54:41.554894 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-329eec4d-9ae0-4346-9f7b-3930d3212d1f tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:41.555340 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-329eec4d-9ae0-4346-9f7b-3930d3212d1f tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:41.556139 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-329eec4d-9ae0-4346-9f7b-3930d3212d1f tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:41.556657 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-329eec4d-9ae0-4346-9f7b-3930d3212d1f tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:41.574445 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-329eec4d-9ae0-4346-9f7b-3930d3212d1f tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Getting quotas for project 40687185a3f94a849d65a09026ea119c. Resources: {'cores', 'instances', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:54:41.578340 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-329eec4d-9ae0-4346-9f7b-3930d3212d1f tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Getting quotas for user 427f3ca9698842b594bd2ca32f575013 and project 40687185a3f94a849d65a09026ea119c. Resources: {'cores', 'instances', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:54:41.588947 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-329eec4d-9ae0-4346-9f7b-3930d3212d1f tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Going to run 1 instances... {{(pid=124266) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:54:41.591189 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-329eec4d-9ae0-4346-9f7b-3930d3212d1f tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 92a873bd-ea25-44c9-9ee8-1a3e948f009d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d74c4a51-21fe-41d5-865a-cb93604ac3aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:54:41.634471 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-329eec4d-9ae0-4346-9f7b-3930d3212d1f tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.489076 May 26 16:54:41.635140 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 514/1022] 10.222.0.102 () {60 vars in 1151 bytes} [Thu May 26 16:54:41 2022] POST /compute/v2.1/servers => generated 382 bytes in 490 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 16:54:41.643337 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:41.644087 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:41.648826 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-e43034e2-7f9a-4e98-bf67-611324452745 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:41.650402 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-e43034e2-7f9a-4e98-bf67-611324452745 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 92a873bd-ea25-44c9-9ee8-1a3e948f009d] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:41.710271 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-e43034e2-7f9a-4e98-bf67-611324452745 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427f3ca9698842b594bd2ca32f575013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40687185a3f94a849d65a09026ea119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:41.717397 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-e43034e2-7f9a-4e98-bf67-611324452745 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] 10.222.0.102 "GET /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d" status: 200 len: 1223 microversion: 2.1 time: 0.075969 May 26 16:54:41.717957 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 509/1023] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:54:41 2022] GET /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d => generated 1223 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:54:42.735823 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-83b1dcf3-3225-4cff-ad07-eb83e381408a tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:42.736413 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-83b1dcf3-3225-4cff-ad07-eb83e381408a tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 92a873bd-ea25-44c9-9ee8-1a3e948f009d] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:42.742746 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-83b1dcf3-3225-4cff-ad07-eb83e381408a tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:42.743199 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-83b1dcf3-3225-4cff-ad07-eb83e381408a tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:42.743983 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-83b1dcf3-3225-4cff-ad07-eb83e381408a tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:42.744464 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-83b1dcf3-3225-4cff-ad07-eb83e381408a tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:42.806314 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-83b1dcf3-3225-4cff-ad07-eb83e381408a tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427f3ca9698842b594bd2ca32f575013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40687185a3f94a849d65a09026ea119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:42.818550 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-83b1dcf3-3225-4cff-ad07-eb83e381408a tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] 10.222.0.102 "GET /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d" status: 200 len: 1275 microversion: 2.1 time: 0.087966 May 26 16:54:42.819588 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 515/1024] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:54:42 2022] GET /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d => generated 1275 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:43.843162 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-4cc3079b-38d0-4b91-a3a4-1ab81657c52b tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:43.843777 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-4cc3079b-38d0-4b91-a3a4-1ab81657c52b tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 92a873bd-ea25-44c9-9ee8-1a3e948f009d] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:43.850804 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4cc3079b-38d0-4b91-a3a4-1ab81657c52b tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:43.851265 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4cc3079b-38d0-4b91-a3a4-1ab81657c52b tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:43.852094 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4cc3079b-38d0-4b91-a3a4-1ab81657c52b tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:43.852602 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-4cc3079b-38d0-4b91-a3a4-1ab81657c52b tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:43.987384 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-4cc3079b-38d0-4b91-a3a4-1ab81657c52b tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427f3ca9698842b594bd2ca32f575013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40687185a3f94a849d65a09026ea119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:43.994997 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-4cc3079b-38d0-4b91-a3a4-1ab81657c52b tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] 10.222.0.102 "GET /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d" status: 200 len: 1323 microversion: 2.1 time: 0.156318 May 26 16:54:43.995571 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 510/1025] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:54:43 2022] GET /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d => generated 1323 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:44.515246 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-95001290-43c5-4d06-8968-a72946b50969 req-3a8c1a46-95be-4704-a9e8-e2798aa09e7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92a873bd-ea25-44c9-9ee8-1a3e948f009d", "tag": "bfdc91b1-627e-4674-b5a3-17569a2be62b"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:54:44.524417 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-95001290-43c5-4d06-8968-a72946b50969 req-3a8c1a46-95be-4704-a9e8-e2798aa09e7b service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:44.524870 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-95001290-43c5-4d06-8968-a72946b50969 req-3a8c1a46-95be-4704-a9e8-e2798aa09e7b service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:44.536810 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-95001290-43c5-4d06-8968-a72946b50969 req-3a8c1a46-95be-4704-a9e8-e2798aa09e7b service nova] Creating event network-changed:bfdc91b1-627e-4674-b5a3-17569a2be62b for instance 92a873bd-ea25-44c9-9ee8-1a3e948f009d on hv-cinder-83607 May 26 16:54:44.541525 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-95001290-43c5-4d06-8968-a72946b50969 req-3a8c1a46-95be-4704-a9e8-e2798aa09e7b service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030820 May 26 16:54:44.542117 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 516/1026] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:54:45.012426 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-feb34ce2-5bb0-4a86-80f1-4399953eff18 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:45.013035 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-feb34ce2-5bb0-4a86-80f1-4399953eff18 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 92a873bd-ea25-44c9-9ee8-1a3e948f009d] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:45.019423 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-feb34ce2-5bb0-4a86-80f1-4399953eff18 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:45.019868 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-feb34ce2-5bb0-4a86-80f1-4399953eff18 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:45.020668 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-feb34ce2-5bb0-4a86-80f1-4399953eff18 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:45.021102 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-feb34ce2-5bb0-4a86-80f1-4399953eff18 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:45.152955 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-feb34ce2-5bb0-4a86-80f1-4399953eff18 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427f3ca9698842b594bd2ca32f575013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40687185a3f94a849d65a09026ea119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:45.158880 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-feb34ce2-5bb0-4a86-80f1-4399953eff18 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] 10.222.0.102 "GET /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d" status: 200 len: 1323 microversion: 2.1 time: 0.150327 May 26 16:54:45.159448 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 511/1027] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:54:45 2022] GET /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d => generated 1323 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:46.177055 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7ef21ae1-c461-4766-8dba-802024fc4046 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:46.177755 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-7ef21ae1-c461-4766-8dba-802024fc4046 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 92a873bd-ea25-44c9-9ee8-1a3e948f009d] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:46.184498 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7ef21ae1-c461-4766-8dba-802024fc4046 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:46.184946 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7ef21ae1-c461-4766-8dba-802024fc4046 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:46.185708 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7ef21ae1-c461-4766-8dba-802024fc4046 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:46.186390 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7ef21ae1-c461-4766-8dba-802024fc4046 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:46.319301 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7ef21ae1-c461-4766-8dba-802024fc4046 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427f3ca9698842b594bd2ca32f575013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40687185a3f94a849d65a09026ea119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:46.326707 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7ef21ae1-c461-4766-8dba-802024fc4046 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] 10.222.0.102 "GET /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d" status: 200 len: 1323 microversion: 2.1 time: 0.154278 May 26 16:54:46.327265 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 517/1028] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:54:46 2022] GET /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d => generated 1323 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:47.343449 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-50e12e2a-59ba-48c5-9a60-f60f289bc6ae tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:47.344059 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-50e12e2a-59ba-48c5-9a60-f60f289bc6ae tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 92a873bd-ea25-44c9-9ee8-1a3e948f009d] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:47.350777 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-50e12e2a-59ba-48c5-9a60-f60f289bc6ae tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:47.351222 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-50e12e2a-59ba-48c5-9a60-f60f289bc6ae tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:47.351995 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-50e12e2a-59ba-48c5-9a60-f60f289bc6ae tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:47.352452 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-50e12e2a-59ba-48c5-9a60-f60f289bc6ae tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:47.495405 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-50e12e2a-59ba-48c5-9a60-f60f289bc6ae tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427f3ca9698842b594bd2ca32f575013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40687185a3f94a849d65a09026ea119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:47.503146 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-50e12e2a-59ba-48c5-9a60-f60f289bc6ae tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] 10.222.0.102 "GET /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d" status: 200 len: 1323 microversion: 2.1 time: 0.163579 May 26 16:54:47.503721 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 512/1029] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:54:47 2022] GET /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d => generated 1323 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:48.520893 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-36572347-9358-4050-ae62-6e7bfd5d8a01 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:48.521499 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-36572347-9358-4050-ae62-6e7bfd5d8a01 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 92a873bd-ea25-44c9-9ee8-1a3e948f009d] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:48.528505 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-36572347-9358-4050-ae62-6e7bfd5d8a01 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:48.528958 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-36572347-9358-4050-ae62-6e7bfd5d8a01 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:48.529721 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-36572347-9358-4050-ae62-6e7bfd5d8a01 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:48.530159 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-36572347-9358-4050-ae62-6e7bfd5d8a01 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:48.664965 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-36572347-9358-4050-ae62-6e7bfd5d8a01 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427f3ca9698842b594bd2ca32f575013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40687185a3f94a849d65a09026ea119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:48.672908 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-36572347-9358-4050-ae62-6e7bfd5d8a01 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] 10.222.0.102 "GET /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d" status: 200 len: 1323 microversion: 2.1 time: 0.155895 May 26 16:54:48.673472 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 518/1030] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:54:48 2022] GET /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d => generated 1323 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:49.689991 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-f9d23da3-4780-4a2f-a313-4fae00199daa tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:49.690633 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-f9d23da3-4780-4a2f-a313-4fae00199daa tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 92a873bd-ea25-44c9-9ee8-1a3e948f009d] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:49.697200 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f9d23da3-4780-4a2f-a313-4fae00199daa tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:49.697649 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f9d23da3-4780-4a2f-a313-4fae00199daa tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:49.698426 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f9d23da3-4780-4a2f-a313-4fae00199daa tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:49.699358 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f9d23da3-4780-4a2f-a313-4fae00199daa tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:50.112972 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-f9d23da3-4780-4a2f-a313-4fae00199daa tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427f3ca9698842b594bd2ca32f575013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40687185a3f94a849d65a09026ea119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:50.120270 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-f9d23da3-4780-4a2f-a313-4fae00199daa tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] 10.222.0.102 "GET /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d" status: 200 len: 1323 microversion: 2.1 time: 0.434533 May 26 16:54:50.121382 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 513/1031] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:54:49 2022] GET /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d => generated 1323 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:51.137339 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-144c3ebb-787f-4c6c-b2d7-6c18ab6445ff tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:51.137937 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-144c3ebb-787f-4c6c-b2d7-6c18ab6445ff tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 92a873bd-ea25-44c9-9ee8-1a3e948f009d] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:51.144339 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-144c3ebb-787f-4c6c-b2d7-6c18ab6445ff tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:51.144811 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-144c3ebb-787f-4c6c-b2d7-6c18ab6445ff tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:51.145558 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-144c3ebb-787f-4c6c-b2d7-6c18ab6445ff tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:51.146036 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-144c3ebb-787f-4c6c-b2d7-6c18ab6445ff tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:51.272910 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-144c3ebb-787f-4c6c-b2d7-6c18ab6445ff tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427f3ca9698842b594bd2ca32f575013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40687185a3f94a849d65a09026ea119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:51.281574 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-144c3ebb-787f-4c6c-b2d7-6c18ab6445ff tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] 10.222.0.102 "GET /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d" status: 200 len: 1323 microversion: 2.1 time: 0.148011 May 26 16:54:51.282149 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 519/1032] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:54:51 2022] GET /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d => generated 1323 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:54:51.389332 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-d6b7889e-d29e-482c-8b41-999a8b7eb071 req-b2584108-8334-483a-96c8-806215fa3d21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92a873bd-ea25-44c9-9ee8-1a3e948f009d", "name": "network-vif-plugged", "status": "completed", "tag": "bfdc91b1-627e-4674-b5a3-17569a2be62b"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:54:51.400511 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-d6b7889e-d29e-482c-8b41-999a8b7eb071 req-b2584108-8334-483a-96c8-806215fa3d21 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:51.400970 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-d6b7889e-d29e-482c-8b41-999a8b7eb071 req-b2584108-8334-483a-96c8-806215fa3d21 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:51.416626 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-d6b7889e-d29e-482c-8b41-999a8b7eb071 req-b2584108-8334-483a-96c8-806215fa3d21 service nova] Creating event network-vif-plugged:bfdc91b1-627e-4674-b5a3-17569a2be62b for instance 92a873bd-ea25-44c9-9ee8-1a3e948f009d on hv-cinder-83607 May 26 16:54:51.426662 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-d6b7889e-d29e-482c-8b41-999a8b7eb071 req-b2584108-8334-483a-96c8-806215fa3d21 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040870 May 26 16:54:51.427793 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 514/1033] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:54:52.298915 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-4829b2d7-627b-4a23-ad35-b19e29463538 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:52.299608 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-4829b2d7-627b-4a23-ad35-b19e29463538 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 92a873bd-ea25-44c9-9ee8-1a3e948f009d] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:52.301606 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:52.302694 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=6 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:52.309452 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4829b2d7-627b-4a23-ad35-b19e29463538 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:52.309905 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4829b2d7-627b-4a23-ad35-b19e29463538 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:52.310694 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4829b2d7-627b-4a23-ad35-b19e29463538 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:52.311390 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4829b2d7-627b-4a23-ad35-b19e29463538 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:52.442645 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-4829b2d7-627b-4a23-ad35-b19e29463538 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427f3ca9698842b594bd2ca32f575013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40687185a3f94a849d65a09026ea119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:52.450703 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-4829b2d7-627b-4a23-ad35-b19e29463538 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] 10.222.0.102 "GET /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d" status: 200 len: 1323 microversion: 2.1 time: 0.155592 May 26 16:54:52.451278 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 520/1034] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:54:52 2022] GET /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d => generated 1323 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:53.468795 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-9faae19a-e867-4eed-a7f0-11b65bacd2c3 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:53.469409 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-9faae19a-e867-4eed-a7f0-11b65bacd2c3 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 92a873bd-ea25-44c9-9ee8-1a3e948f009d] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:53.471381 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell0:SELECT=2 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:53.477904 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9faae19a-e867-4eed-a7f0-11b65bacd2c3 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:53.478349 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9faae19a-e867-4eed-a7f0-11b65bacd2c3 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:53.479111 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9faae19a-e867-4eed-a7f0-11b65bacd2c3 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:53.479547 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9faae19a-e867-4eed-a7f0-11b65bacd2c3 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:53.610972 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-9faae19a-e867-4eed-a7f0-11b65bacd2c3 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427f3ca9698842b594bd2ca32f575013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40687185a3f94a849d65a09026ea119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:53.618548 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-9faae19a-e867-4eed-a7f0-11b65bacd2c3 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] 10.222.0.102 "GET /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d" status: 200 len: 1323 microversion: 2.1 time: 0.154830 May 26 16:54:53.619130 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 515/1035] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:54:53 2022] GET /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d => generated 1323 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:54.634866 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-16e56b16-d757-46b7-9779-b06058fb6db5 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:54.635470 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-16e56b16-d757-46b7-9779-b06058fb6db5 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 92a873bd-ea25-44c9-9ee8-1a3e948f009d] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:54.641932 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-16e56b16-d757-46b7-9779-b06058fb6db5 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:54.642375 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-16e56b16-d757-46b7-9779-b06058fb6db5 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:54.643135 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-16e56b16-d757-46b7-9779-b06058fb6db5 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:54.643569 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-16e56b16-d757-46b7-9779-b06058fb6db5 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:54.775152 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-16e56b16-d757-46b7-9779-b06058fb6db5 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427f3ca9698842b594bd2ca32f575013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40687185a3f94a849d65a09026ea119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:54.783900 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-16e56b16-d757-46b7-9779-b06058fb6db5 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] 10.222.0.102 "GET /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d" status: 200 len: 1512 microversion: 2.1 time: 0.152940 May 26 16:54:54.784708 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 521/1036] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:54:54 2022] GET /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:03.840665 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-e83accc8-a379-4bb4-824f-854c7bd76764 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:03.841227 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-e83accc8-a379-4bb4-824f-854c7bd76764 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:03.843588 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_api:SELECT=16 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:03.844577 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=32 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:03.850932 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e83accc8-a379-4bb4-824f-854c7bd76764 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:03.851378 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e83accc8-a379-4bb4-824f-854c7bd76764 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:03.852153 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e83accc8-a379-4bb4-824f-854c7bd76764 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:03.852616 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e83accc8-a379-4bb4-824f-854c7bd76764 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:03.877066 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-e83accc8-a379-4bb4-824f-854c7bd76764 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3/ips" status: 200 len: 151 microversion: 2.1 time: 0.040612 May 26 16:55:03.877642 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 516/1037] 10.222.0.102 () {58 vars in 1252 bytes} [Thu May 26 16:55:03 2022] GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:55:06.286651 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-4d8a39a8-2513-4629-a0e0-90dd343ec702 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "961f5708-41cd-406c-bcf4-db34d9d0b0a3"}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:55:06.287921 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-4d8a39a8-2513-4629-a0e0-90dd343ec702 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:06.290457 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:06.291108 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=40 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:06.297248 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4d8a39a8-2513-4629-a0e0-90dd343ec702 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:06.297692 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4d8a39a8-2513-4629-a0e0-90dd343ec702 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:06.298451 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4d8a39a8-2513-4629-a0e0-90dd343ec702 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:06.298880 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-4d8a39a8-2513-4629-a0e0-90dd343ec702 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:06.575113 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-4d8a39a8-2513-4629-a0e0-90dd343ec702 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "POST /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293184 May 26 16:55:06.575699 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 522/1038] 10.222.0.102 () {60 vars in 1327 bytes} [Thu May 26 16:55:06 2022] POST /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:55:17.235949 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-b7acec1e-60bb-41c1-a196-c015870aa6d6 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Action: 'create', calling method: .version_select at 0x7f93a3d94ee0>, body: {"keypair": {"name": "tempest-keypair-2076032949", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLD4ocfmXwUKkyUJhrIhlzDSpLQ9gRb3lFaUL3xLObgYaEeZk4/QcFq13IcB+37YEgbIKq0RuQpxyUIDHysUYLzP5gfkfyEyODZzM43SyMmBzi6HEJZjGf0bxBWK7b/0JA=="}} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:55:17.242661 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_api:SELECT=2 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:17.243300 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=4 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:17.254117 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.quota [None req-b7acec1e-60bb-41c1-a196-c015870aa6d6 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Getting quotas for project c56b7ca2b1f54ae782302bead8a35b01. Resources: {'key_pairs'} {{(pid=124267) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:55:17.257986 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.quota [None req-b7acec1e-60bb-41c1-a196-c015870aa6d6 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Getting quotas for user 75cc85261ad441f8993877a959bdd97b and project c56b7ca2b1f54ae782302bead8a35b01. Resources: {'key_pairs'} {{(pid=124267) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:55:17.281564 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-b7acec1e-60bb-41c1-a196-c015870aa6d6 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049537 May 26 16:55:17.282174 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 517/1039] 10.222.0.102 () {60 vars in 1163 bytes} [Thu May 26 16:55:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:55:18.586075 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:18.586847 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:18.591931 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-863d3bbe-32a0-4810-81fe-5c8c4f839fc5 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1111072176", "imageRef": "d74c4a51-21fe-41d5-865a-cb93604ac3aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1ef1a782-8a32-40c0-8c50-f68f3f393fb7"}], "security_groups": [{"name": "tempest-securitygroup--347069849"}], "key_name": "tempest-keypair-2076032949", "user_data": "}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:55:18.695843 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.network.neutron [None req-863d3bbe-32a0-4810-81fe-5c8c4f839fc5 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] validate_networks() for [('1ef1a782-8a32-40c0-8c50-f68f3f393fb7', None, None, None, None, None)] {{(pid=124266) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:55:19.068727 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-863d3bbe-32a0-4810-81fe-5c8c4f839fc5 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Flavor limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:55:19.069182 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-863d3bbe-32a0-4810-81fe-5c8c4f839fc5 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Image limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:55:19.069744 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-863d3bbe-32a0-4810-81fe-5c8c4f839fc5 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Flavor pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:55:19.070070 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-863d3bbe-32a0-4810-81fe-5c8c4f839fc5 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Image pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:55:19.070482 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-863d3bbe-32a0-4810-81fe-5c8c4f839fc5 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:55:19.079365 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-863d3bbe-32a0-4810-81fe-5c8c4f839fc5 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:19.079820 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-863d3bbe-32a0-4810-81fe-5c8c4f839fc5 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:19.080640 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-863d3bbe-32a0-4810-81fe-5c8c4f839fc5 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:19.081079 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-863d3bbe-32a0-4810-81fe-5c8c4f839fc5 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:19.097556 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-863d3bbe-32a0-4810-81fe-5c8c4f839fc5 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Getting quotas for project c56b7ca2b1f54ae782302bead8a35b01. Resources: {'cores', 'instances', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:55:19.101490 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-863d3bbe-32a0-4810-81fe-5c8c4f839fc5 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Getting quotas for user 75cc85261ad441f8993877a959bdd97b and project c56b7ca2b1f54ae782302bead8a35b01. Resources: {'cores', 'instances', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:55:19.112952 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-863d3bbe-32a0-4810-81fe-5c8c4f839fc5 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Going to run 1 instances... {{(pid=124266) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:55:19.115303 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-863d3bbe-32a0-4810-81fe-5c8c4f839fc5 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 97945b79-f060-4f05-aa03-9c46f87623ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d74c4a51-21fe-41d5-865a-cb93604ac3aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:55:19.160385 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-863d3bbe-32a0-4810-81fe-5c8c4f839fc5 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.575702 May 26 16:55:19.161050 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 523/1040] 10.222.0.102 () {60 vars in 1151 bytes} [Thu May 26 16:55:18 2022] POST /compute/v2.1/servers => generated 403 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 16:55:19.171516 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-19e0b222-da5e-4cb5-bc95-29190b630754 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:19.172132 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-19e0b222-da5e-4cb5-bc95-29190b630754 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 97945b79-f060-4f05-aa03-9c46f87623ac] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:19.226097 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-19e0b222-da5e-4cb5-bc95-29190b630754 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:19.233755 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-19e0b222-da5e-4cb5-bc95-29190b630754 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac" status: 200 len: 1246 microversion: 2.1 time: 0.066507 May 26 16:55:19.234321 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 518/1041] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:55:19 2022] GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac => generated 1246 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:20.254851 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-b33d47b8-b0ab-4196-b0d5-91182cafd45b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:20.256459 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-b33d47b8-b0ab-4196-b0d5-91182cafd45b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 97945b79-f060-4f05-aa03-9c46f87623ac] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:20.264960 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b33d47b8-b0ab-4196-b0d5-91182cafd45b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:20.265553 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b33d47b8-b0ab-4196-b0d5-91182cafd45b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:20.266461 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b33d47b8-b0ab-4196-b0d5-91182cafd45b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:20.267003 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-b33d47b8-b0ab-4196-b0d5-91182cafd45b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:20.336512 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-b33d47b8-b0ab-4196-b0d5-91182cafd45b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:20.344951 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-b33d47b8-b0ab-4196-b0d5-91182cafd45b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac" status: 200 len: 1316 microversion: 2.1 time: 0.096928 May 26 16:55:20.346237 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 524/1042] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:55:20 2022] GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac => generated 1316 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:21.363460 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-83986556-bb48-45a9-bb63-63b2667be06a tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:21.363993 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-83986556-bb48-45a9-bb63-63b2667be06a tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 97945b79-f060-4f05-aa03-9c46f87623ac] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:21.371366 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-83986556-bb48-45a9-bb63-63b2667be06a tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:21.371823 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-83986556-bb48-45a9-bb63-63b2667be06a tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:21.372809 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-83986556-bb48-45a9-bb63-63b2667be06a tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:21.373281 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-83986556-bb48-45a9-bb63-63b2667be06a tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:21.531855 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-83986556-bb48-45a9-bb63-63b2667be06a tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:21.541252 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-83986556-bb48-45a9-bb63-63b2667be06a tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac" status: 200 len: 1371 microversion: 2.1 time: 0.182053 May 26 16:55:21.542508 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 519/1043] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:55:21 2022] GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:21.722998 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-1fd96d82-18ed-488f-a47e-0d5ac3d083b7 req-877eedee-3a77-4469-a148-9f942aacc914 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97945b79-f060-4f05-aa03-9c46f87623ac", "tag": "cfcbead4-c344-4ea7-8029-7b093ea3c8eb"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:55:21.732310 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-1fd96d82-18ed-488f-a47e-0d5ac3d083b7 req-877eedee-3a77-4469-a148-9f942aacc914 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:21.733024 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-1fd96d82-18ed-488f-a47e-0d5ac3d083b7 req-877eedee-3a77-4469-a148-9f942aacc914 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:21.746618 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-1fd96d82-18ed-488f-a47e-0d5ac3d083b7 req-877eedee-3a77-4469-a148-9f942aacc914 service nova] Creating event network-changed:cfcbead4-c344-4ea7-8029-7b093ea3c8eb for instance 97945b79-f060-4f05-aa03-9c46f87623ac on hv-cinder-83607 May 26 16:55:21.752625 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-1fd96d82-18ed-488f-a47e-0d5ac3d083b7 req-877eedee-3a77-4469-a148-9f942aacc914 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032773 May 26 16:55:21.753228 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 525/1044] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:55:22.528821 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-f13ae6c0-9e08-4b11-996f-ad02f02cd29f tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4a18c2c-2725-4541-ac1b-23ea0a82fc55", "device": "/dev/sdb"}} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:55:22.530546 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-f13ae6c0-9e08-4b11-996f-ad02f02cd29f tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 92a873bd-ea25-44c9-9ee8-1a3e948f009d] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:22.537703 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f13ae6c0-9e08-4b11-996f-ad02f02cd29f tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:22.538164 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f13ae6c0-9e08-4b11-996f-ad02f02cd29f tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:22.538942 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f13ae6c0-9e08-4b11-996f-ad02f02cd29f tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:22.539384 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f13ae6c0-9e08-4b11-996f-ad02f02cd29f tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:22.559031 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-835f2ba7-578a-4dcb-9901-b0ce6f6dea98 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:22.560014 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-835f2ba7-578a-4dcb-9901-b0ce6f6dea98 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 97945b79-f060-4f05-aa03-9c46f87623ac] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:22.566666 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-835f2ba7-578a-4dcb-9901-b0ce6f6dea98 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:22.567261 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-835f2ba7-578a-4dcb-9901-b0ce6f6dea98 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:22.568288 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-835f2ba7-578a-4dcb-9901-b0ce6f6dea98 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:22.568974 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-835f2ba7-578a-4dcb-9901-b0ce6f6dea98 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:22.720685 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-835f2ba7-578a-4dcb-9901-b0ce6f6dea98 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:22.728362 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-835f2ba7-578a-4dcb-9901-b0ce6f6dea98 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac" status: 200 len: 1371 microversion: 2.1 time: 0.173502 May 26 16:55:22.728999 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 526/1045] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:55:22 2022] GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:55:23.745423 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-930e384f-87ed-4149-a4fa-18ffebd833bc tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:23.746372 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-930e384f-87ed-4149-a4fa-18ffebd833bc tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 97945b79-f060-4f05-aa03-9c46f87623ac] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:23.753163 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-930e384f-87ed-4149-a4fa-18ffebd833bc tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:23.753609 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-930e384f-87ed-4149-a4fa-18ffebd833bc tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:23.754373 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-930e384f-87ed-4149-a4fa-18ffebd833bc tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:23.754802 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-930e384f-87ed-4149-a4fa-18ffebd833bc tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:23.887166 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-930e384f-87ed-4149-a4fa-18ffebd833bc tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:23.895228 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-930e384f-87ed-4149-a4fa-18ffebd833bc tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac" status: 200 len: 1371 microversion: 2.1 time: 0.153925 May 26 16:55:23.895794 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 527/1046] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:55:23 2022] GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:55:24.912562 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7fd9fa0c-101f-491c-8a41-dc2a40587d03 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:24.913425 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-7fd9fa0c-101f-491c-8a41-dc2a40587d03 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 97945b79-f060-4f05-aa03-9c46f87623ac] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:24.919762 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7fd9fa0c-101f-491c-8a41-dc2a40587d03 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:24.920216 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7fd9fa0c-101f-491c-8a41-dc2a40587d03 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:24.921039 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7fd9fa0c-101f-491c-8a41-dc2a40587d03 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:24.921465 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7fd9fa0c-101f-491c-8a41-dc2a40587d03 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:25.053636 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7fd9fa0c-101f-491c-8a41-dc2a40587d03 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:25.061292 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7fd9fa0c-101f-491c-8a41-dc2a40587d03 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac" status: 200 len: 1371 microversion: 2.1 time: 0.153567 May 26 16:55:25.061863 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 528/1047] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:55:24 2022] GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:55:26.055904 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-f13ae6c0-9e08-4b11-996f-ad02f02cd29f tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] 10.222.0.102 "POST /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.530869 May 26 16:55:26.056530 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 520/1048] 10.222.0.102 () {60 vars in 1327 bytes} [Thu May 26 16:55:22 2022] POST /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d/os-volume_attachments => generated 194 bytes in 3532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:55:26.078940 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-999fa79a-23e0-4e21-b14f-a6ce4444ee20 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:26.079581 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-999fa79a-23e0-4e21-b14f-a6ce4444ee20 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 97945b79-f060-4f05-aa03-9c46f87623ac] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:26.087652 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-999fa79a-23e0-4e21-b14f-a6ce4444ee20 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:26.088114 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-999fa79a-23e0-4e21-b14f-a6ce4444ee20 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:26.089274 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-999fa79a-23e0-4e21-b14f-a6ce4444ee20 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:26.089718 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-999fa79a-23e0-4e21-b14f-a6ce4444ee20 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:26.233670 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-999fa79a-23e0-4e21-b14f-a6ce4444ee20 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:26.241021 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-999fa79a-23e0-4e21-b14f-a6ce4444ee20 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac" status: 200 len: 1371 microversion: 2.1 time: 0.166106 May 26 16:55:26.241597 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 529/1049] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:55:26 2022] GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:27.259423 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-9618459b-c9ba-449a-be0d-6fbb3c1616e6 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:27.260150 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-9618459b-c9ba-449a-be0d-6fbb3c1616e6 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 97945b79-f060-4f05-aa03-9c46f87623ac] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:27.266639 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9618459b-c9ba-449a-be0d-6fbb3c1616e6 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:27.267080 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9618459b-c9ba-449a-be0d-6fbb3c1616e6 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:27.267840 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9618459b-c9ba-449a-be0d-6fbb3c1616e6 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:27.268266 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9618459b-c9ba-449a-be0d-6fbb3c1616e6 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:27.399220 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-9618459b-c9ba-449a-be0d-6fbb3c1616e6 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:27.406827 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-9618459b-c9ba-449a-be0d-6fbb3c1616e6 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac" status: 200 len: 1371 microversion: 2.1 time: 0.152399 May 26 16:55:27.407403 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 521/1050] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:55:27 2022] GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:28.424425 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-bac9f3a4-86d0-46be-b913-50a67371339f tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:28.425523 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-bac9f3a4-86d0-46be-b913-50a67371339f tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 97945b79-f060-4f05-aa03-9c46f87623ac] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:28.431943 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bac9f3a4-86d0-46be-b913-50a67371339f tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:28.432411 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bac9f3a4-86d0-46be-b913-50a67371339f tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:28.433167 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bac9f3a4-86d0-46be-b913-50a67371339f tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:28.433598 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bac9f3a4-86d0-46be-b913-50a67371339f tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:28.563364 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-bac9f3a4-86d0-46be-b913-50a67371339f tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:28.571806 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-bac9f3a4-86d0-46be-b913-50a67371339f tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac" status: 200 len: 1371 microversion: 2.1 time: 0.151262 May 26 16:55:28.572358 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 530/1051] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:55:28 2022] GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:29.507907 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-c5a192e7-7dde-4a87-86e2-248e6a8e4a54 req-7a900e0d-d0fa-4f2d-a77d-974900502f73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97945b79-f060-4f05-aa03-9c46f87623ac", "name": "network-vif-plugged", "status": "completed", "tag": "cfcbead4-c344-4ea7-8029-7b093ea3c8eb"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:55:29.512187 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell0:SELECT=6 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:29.519755 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-c5a192e7-7dde-4a87-86e2-248e6a8e4a54 req-7a900e0d-d0fa-4f2d-a77d-974900502f73 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:29.520206 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-c5a192e7-7dde-4a87-86e2-248e6a8e4a54 req-7a900e0d-d0fa-4f2d-a77d-974900502f73 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:29.531558 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-c5a192e7-7dde-4a87-86e2-248e6a8e4a54 req-7a900e0d-d0fa-4f2d-a77d-974900502f73 service nova] Creating event network-vif-plugged:cfcbead4-c344-4ea7-8029-7b093ea3c8eb for instance 97945b79-f060-4f05-aa03-9c46f87623ac on hv-cinder-83607 May 26 16:55:29.536493 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-c5a192e7-7dde-4a87-86e2-248e6a8e4a54 req-7a900e0d-d0fa-4f2d-a77d-974900502f73 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033110 May 26 16:55:29.537083 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 522/1052] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:55:29.589494 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-03743029-e016-4056-958a-59032d79c59a tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:29.590115 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-03743029-e016-4056-958a-59032d79c59a tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 97945b79-f060-4f05-aa03-9c46f87623ac] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:29.592081 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:29.592767 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=6 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:29.599248 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-03743029-e016-4056-958a-59032d79c59a tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:29.599699 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-03743029-e016-4056-958a-59032d79c59a tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:29.600502 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-03743029-e016-4056-958a-59032d79c59a tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:29.600937 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-03743029-e016-4056-958a-59032d79c59a tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:29.743668 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-03743029-e016-4056-958a-59032d79c59a tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:29.753884 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-03743029-e016-4056-958a-59032d79c59a tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac" status: 200 len: 1371 microversion: 2.1 time: 0.167719 May 26 16:55:29.754492 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 531/1053] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:55:29 2022] GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:55:30.773636 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-f1cfcf69-bc87-48ed-b877-b51832b17af0 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:30.774332 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-f1cfcf69-bc87-48ed-b877-b51832b17af0 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 97945b79-f060-4f05-aa03-9c46f87623ac] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:30.780507 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f1cfcf69-bc87-48ed-b877-b51832b17af0 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:30.780971 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f1cfcf69-bc87-48ed-b877-b51832b17af0 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:30.781714 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f1cfcf69-bc87-48ed-b877-b51832b17af0 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:30.782417 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-f1cfcf69-bc87-48ed-b877-b51832b17af0 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:30.914361 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-f1cfcf69-bc87-48ed-b877-b51832b17af0 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:30.921807 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-f1cfcf69-bc87-48ed-b877-b51832b17af0 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac" status: 200 len: 1371 microversion: 2.1 time: 0.154536 May 26 16:55:30.922532 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 523/1054] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:55:30 2022] GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:31.939256 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3e27aef3-4a69-4420-a517-43f883e96300 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:31.939818 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-3e27aef3-4a69-4420-a517-43f883e96300 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 97945b79-f060-4f05-aa03-9c46f87623ac] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:31.946314 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3e27aef3-4a69-4420-a517-43f883e96300 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:31.946754 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3e27aef3-4a69-4420-a517-43f883e96300 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:31.947508 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3e27aef3-4a69-4420-a517-43f883e96300 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:31.947937 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3e27aef3-4a69-4420-a517-43f883e96300 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:32.080225 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3e27aef3-4a69-4420-a517-43f883e96300 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:32.088048 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-3e27aef3-4a69-4420-a517-43f883e96300 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac" status: 200 len: 1561 microversion: 2.1 time: 0.153028 May 26 16:55:32.088667 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 532/1055] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:55:31 2022] GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:32.104777 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-da90cf46-dc49-43d2-a129-45d444371b89 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:32.105334 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-da90cf46-dc49-43d2-a129-45d444371b89 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 97945b79-f060-4f05-aa03-9c46f87623ac] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:32.111945 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-da90cf46-dc49-43d2-a129-45d444371b89 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:32.112439 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-da90cf46-dc49-43d2-a129-45d444371b89 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:32.113227 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-da90cf46-dc49-43d2-a129-45d444371b89 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:32.113673 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-da90cf46-dc49-43d2-a129-45d444371b89 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:32.194563 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-da90cf46-dc49-43d2-a129-45d444371b89 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093776 May 26 16:55:32.195159 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 524/1056] 10.222.0.102 () {58 vars in 1279 bytes} [Thu May 26 16:55:32 2022] GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:55:33.365305 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-8b13ef41-112f-4c19-9c9a-5473c4281e46 req-76b19185-b55b-4c2b-b325-5e2f7ae8bbda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97945b79-f060-4f05-aa03-9c46f87623ac", "tag": "cfcbead4-c344-4ea7-8029-7b093ea3c8eb"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:55:33.373747 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-8b13ef41-112f-4c19-9c9a-5473c4281e46 req-76b19185-b55b-4c2b-b325-5e2f7ae8bbda service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:33.374199 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-8b13ef41-112f-4c19-9c9a-5473c4281e46 req-76b19185-b55b-4c2b-b325-5e2f7ae8bbda service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:33.385196 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-8b13ef41-112f-4c19-9c9a-5473c4281e46 req-76b19185-b55b-4c2b-b325-5e2f7ae8bbda service nova] Creating event network-changed:cfcbead4-c344-4ea7-8029-7b093ea3c8eb for instance 97945b79-f060-4f05-aa03-9c46f87623ac on hv-cinder-83607 May 26 16:55:33.390390 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-8b13ef41-112f-4c19-9c9a-5473c4281e46 req-76b19185-b55b-4c2b-b325-5e2f7ae8bbda service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029434 May 26 16:55:33.391548 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 533/1057] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:55:55.929033 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:55.929783 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:55.934566 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-105cce6d-651e-4e53-8556-87e0bfec92c2 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:55.935059 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-105cce6d-651e-4e53-8556-87e0bfec92c2 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 92a873bd-ea25-44c9-9ee8-1a3e948f009d] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:55.942577 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-105cce6d-651e-4e53-8556-87e0bfec92c2 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:55.943135 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-105cce6d-651e-4e53-8556-87e0bfec92c2 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:55.944042 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-105cce6d-651e-4e53-8556-87e0bfec92c2 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:55.944508 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-105cce6d-651e-4e53-8556-87e0bfec92c2 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:56.032206 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.objects.instance [None req-105cce6d-651e-4e53-8556-87e0bfec92c2 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lazy-loading 'services' on Instance uuid 92a873bd-ea25-44c9-9ee8-1a3e948f009d {{(pid=124267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:55:56.108448 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-105cce6d-651e-4e53-8556-87e0bfec92c2 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] 10.222.0.102 "DELETE /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d/os-volume_attachments/f4a18c2c-2725-4541-ac1b-23ea0a82fc55" status: 202 len: 0 microversion: 2.1 time: 0.180610 May 26 16:55:56.109041 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 525/1058] 10.222.0.102 () {58 vars in 1420 bytes} [Thu May 26 16:55:55 2022] DELETE /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d/os-volume_attachments/f4a18c2c-2725-4541-ac1b-23ea0a82fc55 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 16:55:57.222348 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:57.223097 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=54 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:57.227138 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-596c02db-84a6-4738-bafc-e1012ccf9129 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:57.227721 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-596c02db-84a6-4738-bafc-e1012ccf9129 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 92a873bd-ea25-44c9-9ee8-1a3e948f009d] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:57.234958 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-596c02db-84a6-4738-bafc-e1012ccf9129 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:57.235405 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-596c02db-84a6-4738-bafc-e1012ccf9129 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:57.236165 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-596c02db-84a6-4738-bafc-e1012ccf9129 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:57.236628 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-596c02db-84a6-4738-bafc-e1012ccf9129 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:57.261776 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-596c02db-84a6-4738-bafc-e1012ccf9129 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 92a873bd-ea25-44c9-9ee8-1a3e948f009d] Going to try to terminate instance {{(pid=124266) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 16:55:57.335336 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-596c02db-84a6-4738-bafc-e1012ccf9129 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] 10.222.0.102 "DELETE /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d" status: 204 len: 0 microversion: 2.1 time: 0.114849 May 26 16:55:57.335959 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 534/1059] 10.222.0.102 () {58 vars in 1243 bytes} [Thu May 26 16:55:57 2022] DELETE /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 16:55:57.348026 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-17aa5737-5dab-4419-ac2c-e89f4463ba93 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:57.348866 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-17aa5737-5dab-4419-ac2c-e89f4463ba93 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 92a873bd-ea25-44c9-9ee8-1a3e948f009d] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:57.355626 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-17aa5737-5dab-4419-ac2c-e89f4463ba93 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:57.356067 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-17aa5737-5dab-4419-ac2c-e89f4463ba93 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:57.356855 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-17aa5737-5dab-4419-ac2c-e89f4463ba93 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:57.357287 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-17aa5737-5dab-4419-ac2c-e89f4463ba93 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:57.485077 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-17aa5737-5dab-4419-ac2c-e89f4463ba93 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427f3ca9698842b594bd2ca32f575013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40687185a3f94a849d65a09026ea119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:57.494552 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-17aa5737-5dab-4419-ac2c-e89f4463ba93 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] 10.222.0.102 "GET /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d" status: 200 len: 1518 microversion: 2.1 time: 0.153600 May 26 16:55:57.495134 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 526/1060] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:55:57 2022] GET /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:58.511730 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d8650d8b-51ca-482c-a965-bf49caf08cfb tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:58.512518 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d8650d8b-51ca-482c-a965-bf49caf08cfb tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 92a873bd-ea25-44c9-9ee8-1a3e948f009d] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:58.519674 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d8650d8b-51ca-482c-a965-bf49caf08cfb tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:58.520113 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d8650d8b-51ca-482c-a965-bf49caf08cfb tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:58.520896 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d8650d8b-51ca-482c-a965-bf49caf08cfb tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:58.521328 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d8650d8b-51ca-482c-a965-bf49caf08cfb tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:58.652839 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d8650d8b-51ca-482c-a965-bf49caf08cfb tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427f3ca9698842b594bd2ca32f575013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40687185a3f94a849d65a09026ea119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:58.660058 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d8650d8b-51ca-482c-a965-bf49caf08cfb tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] 10.222.0.102 "GET /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d" status: 200 len: 1518 microversion: 2.1 time: 0.152581 May 26 16:55:58.660720 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 535/1061] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:55:58 2022] GET /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:59.678089 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-c3ebc1fe-7b56-4264-a111-8562552e1fd8 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:59.678716 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-c3ebc1fe-7b56-4264-a111-8562552e1fd8 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 92a873bd-ea25-44c9-9ee8-1a3e948f009d] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:59.686074 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c3ebc1fe-7b56-4264-a111-8562552e1fd8 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:59.686530 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c3ebc1fe-7b56-4264-a111-8562552e1fd8 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:59.687449 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c3ebc1fe-7b56-4264-a111-8562552e1fd8 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:59.687762 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c3ebc1fe-7b56-4264-a111-8562552e1fd8 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:59.825530 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-c3ebc1fe-7b56-4264-a111-8562552e1fd8 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427f3ca9698842b594bd2ca32f575013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40687185a3f94a849d65a09026ea119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:59.835361 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-c3ebc1fe-7b56-4264-a111-8562552e1fd8 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] 10.222.0.102 "GET /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d" status: 200 len: 1518 microversion: 2.1 time: 0.162344 May 26 16:55:59.836174 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 527/1062] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:55:59 2022] GET /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:59.992501 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-860ed38d-5d20-4f33-b4b3-f907ca6bbc1d req-b3abfb9f-c0a0-4bd6-90e3-63e89e65a05c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92a873bd-ea25-44c9-9ee8-1a3e948f009d", "name": "network-vif-deleted", "tag": "bfdc91b1-627e-4674-b5a3-17569a2be62b"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:56:00.001298 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-860ed38d-5d20-4f33-b4b3-f907ca6bbc1d req-b3abfb9f-c0a0-4bd6-90e3-63e89e65a05c service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:00.001749 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-860ed38d-5d20-4f33-b4b3-f907ca6bbc1d req-b3abfb9f-c0a0-4bd6-90e3-63e89e65a05c service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:00.012735 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-860ed38d-5d20-4f33-b4b3-f907ca6bbc1d req-b3abfb9f-c0a0-4bd6-90e3-63e89e65a05c service nova] Creating event network-vif-deleted:bfdc91b1-627e-4674-b5a3-17569a2be62b for instance 92a873bd-ea25-44c9-9ee8-1a3e948f009d on hv-cinder-83607 May 26 16:56:00.017889 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-860ed38d-5d20-4f33-b4b3-f907ca6bbc1d req-b3abfb9f-c0a0-4bd6-90e3-63e89e65a05c service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029108 May 26 16:56:00.018504 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 536/1063] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:56:00.852726 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-ca5d7af2-57ba-48ff-9329-a74187d4226a tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:00.853429 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-ca5d7af2-57ba-48ff-9329-a74187d4226a tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 92a873bd-ea25-44c9-9ee8-1a3e948f009d] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:00.859801 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ca5d7af2-57ba-48ff-9329-a74187d4226a tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:00.860250 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ca5d7af2-57ba-48ff-9329-a74187d4226a tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:00.861051 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ca5d7af2-57ba-48ff-9329-a74187d4226a tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:00.861484 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ca5d7af2-57ba-48ff-9329-a74187d4226a tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:00.875345 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.wsgi [None req-ca5d7af2-57ba-48ff-9329-a74187d4226a tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] HTTP exception thrown: Instance 92a873bd-ea25-44c9-9ee8-1a3e948f009d could not be found. May 26 16:56:00.877019 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-ca5d7af2-57ba-48ff-9329-a74187d4226a tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Request method failure captured: May 26 16:56:00.877019 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: request: GET /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d HTTP/1.1 May 26 16:56:00.877019 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept: application/json May 26 16:56:00.877019 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept-Encoding: identity May 26 16:56:00.877019 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Connection: close May 26 16:56:00.877019 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Length: 0 May 26 16:56:00.877019 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Type: application/json May 26 16:56:00.877019 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Host: 10.222.0.102 May 26 16:56:00.877019 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Openstack-System-Scope: None May 26 16:56:00.877019 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: User-Agent: python-urllib3/1.26.9 May 26 16:56:00.877019 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Auth-Token: gAAAAABij7DP6I_z6Q9ph9z-494b9W4TsCJ9vYjyHV3Qq1rO406I3YBas9RBWWW-BWs5nRk41LZ_pM2sRhKi3F9E2LTdP9fvd__PaYN4o1e4Wog_OFMgIoTFw82VUtgXHg0g4BS5X00cAKSts9VG2IKTmtk9tJu2FaJcKzz23-0SUN1atzkcb1Y May 26 16:56:00.877019 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Id: None May 26 16:56:00.877019 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Name: None May 26 16:56:00.877019 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Identity-Status: Confirmed May 26 16:56:00.877019 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Is-Admin-Project: True May 26 16:56:00.877019 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Id: default May 26 16:56:00.877019 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Name: Default May 26 16:56:00.877019 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Id: 40687185a3f94a849d65a09026ea119c May 26 16:56:00.877019 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1701105710 May 26 16:56:00.877019 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Role: reader,member May 26 16:56:00.877019 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Roles: reader,member May 26 16:56:00.879328 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/40687185a3f94a849d65a09026ea119c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/40687185a3f94a849d65a09026ea119c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/40687185a3f94a849d65a09026ea119c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_40687185a3f94a849d65a09026ea119c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:56:00.879328 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant: tempest-VolumesSnapshotTestJSON-1701105710 May 26 16:56:00.879328 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Id: 40687185a3f94a849d65a09026ea119c May 26 16:56:00.879328 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1701105710 May 26 16:56:00.879328 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User: tempest-VolumesSnapshotTestJSON-1701105710-project May 26 16:56:00.879328 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Id: default May 26 16:56:00.879328 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Name: Default May 26 16:56:00.879328 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Id: 427f3ca9698842b594bd2ca32f575013 May 26 16:56:00.879328 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Name: tempest-VolumesSnapshotTestJSON-1701105710-project May 26 16:56:00.879328 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: method: > May 26 16:56:00.879328 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: exception: Instance 92a873bd-ea25-44c9-9ee8-1a3e948f009d could not be found. May 26 16:56:00.879328 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: action_args: {'id': '92a873bd-ea25-44c9-9ee8-1a3e948f009d'} May 26 16:56:00.880442 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:56:00.880442 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:56:00.880442 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:56:00.880442 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:56:00.880442 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:56:00.880442 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:56:00.880442 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:56:00.880442 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:56:00.880442 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:56:00.880442 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:56:00.880442 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92a873bd-ea25-44c9-9ee8-1a3e948f009d could not be found. May 26 16:56:00.880442 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:56:00.880442 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:56:00.880442 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:56:00.880442 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:56:00.880442 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:56:00.880442 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:56:00.880442 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:56:00.880442 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:56:00.880442 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:56:00.882080 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:56:00.882080 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 16:56:00.882080 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 16:56:00.882080 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:56:00.882080 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:56:00.882080 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:56:00.882080 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:56:00.882080 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92a873bd-ea25-44c9-9ee8-1a3e948f009d could not be found. May 26 16:56:00.882080 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:56:00.882080 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:56:00.882080 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:56:00.882080 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:56:00.882080 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:56:00.882080 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:56:00.882080 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:56:00.882080 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:56:00.882080 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92a873bd-ea25-44c9-9ee8-1a3e948f009d could not be found. May 26 16:56:00.882080 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:56:00.883488 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-ca5d7af2-57ba-48ff-9329-a74187d4226a tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Returning 404 to user: Instance 92a873bd-ea25-44c9-9ee8-1a3e948f009d could not be found. {{(pid=124267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:56:00.883488 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-ca5d7af2-57ba-48ff-9329-a74187d4226a tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] 10.222.0.102 "GET /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d" status: 404 len: 111 microversion: 2.1 time: 0.029759 May 26 16:56:00.883488 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 528/1064] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:56:00 2022] GET /compute/v2.1/servers/92a873bd-ea25-44c9-9ee8-1a3e948f009d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 16:56:03.830157 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 16:56:03.830910 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Thu May 26 16:56:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 16:56:10.805011 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 16:56:10.805614 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Thu May 26 16:56:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 16:56:12.776734 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:12.777481 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:12.781807 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f596b3da-a5c7-46f8-94a9-0b6a67479618 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1809198136", "imageRef": "d74c4a51-21fe-41d5-865a-cb93604ac3aa", "flavorRef": "452", "networks": [{"uuid": "f4d338af-1652-45c0-bf27-5f27d7749e08"}]}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:56:13.029750 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.network.neutron [None req-f596b3da-a5c7-46f8-94a9-0b6a67479618 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] validate_networks() for [('f4d338af-1652-45c0-bf27-5f27d7749e08', None, None, None, None, None)] {{(pid=124266) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:56:13.373784 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-f596b3da-a5c7-46f8-94a9-0b6a67479618 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Flavor limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:56:13.374213 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-f596b3da-a5c7-46f8-94a9-0b6a67479618 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Image limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:56:13.374688 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-f596b3da-a5c7-46f8-94a9-0b6a67479618 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Flavor pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:56:13.375104 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-f596b3da-a5c7-46f8-94a9-0b6a67479618 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Image pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:56:13.375533 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-f596b3da-a5c7-46f8-94a9-0b6a67479618 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:56:13.384555 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f596b3da-a5c7-46f8-94a9-0b6a67479618 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:13.384988 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f596b3da-a5c7-46f8-94a9-0b6a67479618 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:13.385790 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f596b3da-a5c7-46f8-94a9-0b6a67479618 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:13.386230 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f596b3da-a5c7-46f8-94a9-0b6a67479618 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:13.403091 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-f596b3da-a5c7-46f8-94a9-0b6a67479618 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Getting quotas for project 40687185a3f94a849d65a09026ea119c. Resources: {'cores', 'instances', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:56:13.407091 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-f596b3da-a5c7-46f8-94a9-0b6a67479618 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Getting quotas for user 427f3ca9698842b594bd2ca32f575013 and project 40687185a3f94a849d65a09026ea119c. Resources: {'cores', 'instances', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:56:13.418670 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f596b3da-a5c7-46f8-94a9-0b6a67479618 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Going to run 1 instances... {{(pid=124266) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:56:13.421037 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f596b3da-a5c7-46f8-94a9-0b6a67479618 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 32e82b5a-f25b-413e-88a3-cf20b4979955] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d74c4a51-21fe-41d5-865a-cb93604ac3aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:56:13.465326 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f596b3da-a5c7-46f8-94a9-0b6a67479618 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.690148 May 26 16:56:13.465974 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 537/1065] 10.222.0.102 () {60 vars in 1151 bytes} [Thu May 26 16:56:12 2022] POST /compute/v2.1/servers => generated 382 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 16:56:13.476633 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-5369ebad-0779-4d18-84f1-4f9be10f8609 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:13.477282 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-5369ebad-0779-4d18-84f1-4f9be10f8609 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 32e82b5a-f25b-413e-88a3-cf20b4979955] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:13.479533 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_api:SELECT=8 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:13.480163 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:13.585258 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-5369ebad-0779-4d18-84f1-4f9be10f8609 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427f3ca9698842b594bd2ca32f575013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40687185a3f94a849d65a09026ea119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:13.592577 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-5369ebad-0779-4d18-84f1-4f9be10f8609 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] 10.222.0.102 "GET /compute/v2.1/servers/32e82b5a-f25b-413e-88a3-cf20b4979955" status: 200 len: 1223 microversion: 2.1 time: 0.120359 May 26 16:56:13.593225 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 529/1066] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:56:13 2022] GET /compute/v2.1/servers/32e82b5a-f25b-413e-88a3-cf20b4979955 => generated 1223 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:14.609355 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2ae746cd-5cd0-46e6-802c-164fc5621544 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:14.610278 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2ae746cd-5cd0-46e6-802c-164fc5621544 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 32e82b5a-f25b-413e-88a3-cf20b4979955] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:14.618398 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2ae746cd-5cd0-46e6-802c-164fc5621544 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:14.618846 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2ae746cd-5cd0-46e6-802c-164fc5621544 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:14.619898 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2ae746cd-5cd0-46e6-802c-164fc5621544 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:14.620240 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2ae746cd-5cd0-46e6-802c-164fc5621544 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:14.686923 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-2ae746cd-5cd0-46e6-802c-164fc5621544 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427f3ca9698842b594bd2ca32f575013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40687185a3f94a849d65a09026ea119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:14.694614 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2ae746cd-5cd0-46e6-802c-164fc5621544 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] 10.222.0.102 "GET /compute/v2.1/servers/32e82b5a-f25b-413e-88a3-cf20b4979955" status: 200 len: 1281 microversion: 2.1 time: 0.089749 May 26 16:56:14.695184 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 538/1067] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:56:14 2022] GET /compute/v2.1/servers/32e82b5a-f25b-413e-88a3-cf20b4979955 => generated 1281 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:15.711496 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-1fb03aa2-816c-4c98-9178-02847ced116c tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:15.712215 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-1fb03aa2-816c-4c98-9178-02847ced116c tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 32e82b5a-f25b-413e-88a3-cf20b4979955] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:15.720388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1fb03aa2-816c-4c98-9178-02847ced116c tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:15.720848 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1fb03aa2-816c-4c98-9178-02847ced116c tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:15.721639 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1fb03aa2-816c-4c98-9178-02847ced116c tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:15.722080 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1fb03aa2-816c-4c98-9178-02847ced116c tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:15.794912 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-ecf9c25d-295b-4a0f-955c-5f1dd2d2d2ea req-88902867-874b-49c6-a4ef-f86c4933832a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32e82b5a-f25b-413e-88a3-cf20b4979955", "tag": "5cf5bca7-b167-4637-871d-74fbe13ee8e0"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:56:15.805124 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-ecf9c25d-295b-4a0f-955c-5f1dd2d2d2ea req-88902867-874b-49c6-a4ef-f86c4933832a service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:15.805581 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-ecf9c25d-295b-4a0f-955c-5f1dd2d2d2ea req-88902867-874b-49c6-a4ef-f86c4933832a service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:15.820332 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-ecf9c25d-295b-4a0f-955c-5f1dd2d2d2ea req-88902867-874b-49c6-a4ef-f86c4933832a service nova] Creating event network-changed:5cf5bca7-b167-4637-871d-74fbe13ee8e0 for instance 32e82b5a-f25b-413e-88a3-cf20b4979955 on hv-cinder-83607 May 26 16:56:15.824981 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-ecf9c25d-295b-4a0f-955c-5f1dd2d2d2ea req-88902867-874b-49c6-a4ef-f86c4933832a service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033850 May 26 16:56:15.825781 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 539/1068] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:56:15.879611 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-1fb03aa2-816c-4c98-9178-02847ced116c tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427f3ca9698842b594bd2ca32f575013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40687185a3f94a849d65a09026ea119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:15.887167 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-1fb03aa2-816c-4c98-9178-02847ced116c tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] 10.222.0.102 "GET /compute/v2.1/servers/32e82b5a-f25b-413e-88a3-cf20b4979955" status: 200 len: 1323 microversion: 2.1 time: 0.179977 May 26 16:56:15.887761 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 530/1069] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:56:15 2022] GET /compute/v2.1/servers/32e82b5a-f25b-413e-88a3-cf20b4979955 => generated 1323 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:16.905848 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3c6c2f77-afc4-48fd-90bc-786a42e9fea7 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:16.906469 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-3c6c2f77-afc4-48fd-90bc-786a42e9fea7 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 32e82b5a-f25b-413e-88a3-cf20b4979955] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:16.913223 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3c6c2f77-afc4-48fd-90bc-786a42e9fea7 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:16.913672 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3c6c2f77-afc4-48fd-90bc-786a42e9fea7 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:16.914435 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3c6c2f77-afc4-48fd-90bc-786a42e9fea7 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:16.914871 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3c6c2f77-afc4-48fd-90bc-786a42e9fea7 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:17.044721 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-3c6c2f77-afc4-48fd-90bc-786a42e9fea7 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427f3ca9698842b594bd2ca32f575013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40687185a3f94a849d65a09026ea119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:17.052262 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-3c6c2f77-afc4-48fd-90bc-786a42e9fea7 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] 10.222.0.102 "GET /compute/v2.1/servers/32e82b5a-f25b-413e-88a3-cf20b4979955" status: 200 len: 1323 microversion: 2.1 time: 0.151179 May 26 16:56:17.052855 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 540/1070] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:56:16 2022] GET /compute/v2.1/servers/32e82b5a-f25b-413e-88a3-cf20b4979955 => generated 1323 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:18.069651 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-68397203-9ed0-479e-bc71-77cbb7290f12 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:18.070266 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-68397203-9ed0-479e-bc71-77cbb7290f12 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 32e82b5a-f25b-413e-88a3-cf20b4979955] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:18.076884 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-68397203-9ed0-479e-bc71-77cbb7290f12 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:18.077334 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-68397203-9ed0-479e-bc71-77cbb7290f12 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:18.078097 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-68397203-9ed0-479e-bc71-77cbb7290f12 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:18.078537 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-68397203-9ed0-479e-bc71-77cbb7290f12 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:18.214307 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-68397203-9ed0-479e-bc71-77cbb7290f12 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427f3ca9698842b594bd2ca32f575013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40687185a3f94a849d65a09026ea119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:18.223140 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-68397203-9ed0-479e-bc71-77cbb7290f12 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] 10.222.0.102 "GET /compute/v2.1/servers/32e82b5a-f25b-413e-88a3-cf20b4979955" status: 200 len: 1323 microversion: 2.1 time: 0.157669 May 26 16:56:18.223976 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 531/1071] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:56:18 2022] GET /compute/v2.1/servers/32e82b5a-f25b-413e-88a3-cf20b4979955 => generated 1323 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:19.242512 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-bebd006f-d660-4a12-a04e-850bf1ed1823 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:19.243166 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-bebd006f-d660-4a12-a04e-850bf1ed1823 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 32e82b5a-f25b-413e-88a3-cf20b4979955] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:19.249691 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bebd006f-d660-4a12-a04e-850bf1ed1823 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:19.250146 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bebd006f-d660-4a12-a04e-850bf1ed1823 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:19.250917 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bebd006f-d660-4a12-a04e-850bf1ed1823 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:19.251357 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-bebd006f-d660-4a12-a04e-850bf1ed1823 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:19.380909 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-bebd006f-d660-4a12-a04e-850bf1ed1823 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427f3ca9698842b594bd2ca32f575013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40687185a3f94a849d65a09026ea119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:19.388205 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-bebd006f-d660-4a12-a04e-850bf1ed1823 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] 10.222.0.102 "GET /compute/v2.1/servers/32e82b5a-f25b-413e-88a3-cf20b4979955" status: 200 len: 1323 microversion: 2.1 time: 0.149615 May 26 16:56:19.388874 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 541/1072] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:56:19 2022] GET /compute/v2.1/servers/32e82b5a-f25b-413e-88a3-cf20b4979955 => generated 1323 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:20.410534 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-ea67a517-b13d-4fa6-a99f-7628224a2a1a tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:20.411168 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-ea67a517-b13d-4fa6-a99f-7628224a2a1a tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 32e82b5a-f25b-413e-88a3-cf20b4979955] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:20.417890 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ea67a517-b13d-4fa6-a99f-7628224a2a1a tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:20.418344 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ea67a517-b13d-4fa6-a99f-7628224a2a1a tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:20.419122 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ea67a517-b13d-4fa6-a99f-7628224a2a1a tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:20.419564 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ea67a517-b13d-4fa6-a99f-7628224a2a1a tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:20.558060 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-ea67a517-b13d-4fa6-a99f-7628224a2a1a tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427f3ca9698842b594bd2ca32f575013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40687185a3f94a849d65a09026ea119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:20.565974 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-ea67a517-b13d-4fa6-a99f-7628224a2a1a tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] 10.222.0.102 "GET /compute/v2.1/servers/32e82b5a-f25b-413e-88a3-cf20b4979955" status: 200 len: 1323 microversion: 2.1 time: 0.159277 May 26 16:56:20.567053 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 532/1073] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:56:20 2022] GET /compute/v2.1/servers/32e82b5a-f25b-413e-88a3-cf20b4979955 => generated 1323 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:21.583809 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-129b09fb-c61d-4454-a10e-3e81aaad0bf0 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:21.584438 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-129b09fb-c61d-4454-a10e-3e81aaad0bf0 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 32e82b5a-f25b-413e-88a3-cf20b4979955] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:21.591087 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-129b09fb-c61d-4454-a10e-3e81aaad0bf0 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:21.591540 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-129b09fb-c61d-4454-a10e-3e81aaad0bf0 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:21.592680 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-129b09fb-c61d-4454-a10e-3e81aaad0bf0 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:21.593328 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-129b09fb-c61d-4454-a10e-3e81aaad0bf0 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:21.705939 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-c70d142a-5877-4c0e-8e8b-ac8d4958e7ff req-9bc90f8d-02d3-4d02-ac3b-c6c531a6ce6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32e82b5a-f25b-413e-88a3-cf20b4979955", "name": "network-vif-plugged", "status": "completed", "tag": "5cf5bca7-b167-4637-871d-74fbe13ee8e0"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:56:21.714681 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-c70d142a-5877-4c0e-8e8b-ac8d4958e7ff req-9bc90f8d-02d3-4d02-ac3b-c6c531a6ce6b service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:21.715488 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-c70d142a-5877-4c0e-8e8b-ac8d4958e7ff req-9bc90f8d-02d3-4d02-ac3b-c6c531a6ce6b service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:21.727647 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-c70d142a-5877-4c0e-8e8b-ac8d4958e7ff req-9bc90f8d-02d3-4d02-ac3b-c6c531a6ce6b service nova] Creating event network-vif-plugged:5cf5bca7-b167-4637-871d-74fbe13ee8e0 for instance 32e82b5a-f25b-413e-88a3-cf20b4979955 on hv-cinder-83607 May 26 16:56:21.733821 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-129b09fb-c61d-4454-a10e-3e81aaad0bf0 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427f3ca9698842b594bd2ca32f575013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40687185a3f94a849d65a09026ea119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:21.739237 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-c70d142a-5877-4c0e-8e8b-ac8d4958e7ff req-9bc90f8d-02d3-4d02-ac3b-c6c531a6ce6b service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038084 May 26 16:56:21.739841 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 533/1074] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:56:21.744416 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-129b09fb-c61d-4454-a10e-3e81aaad0bf0 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] 10.222.0.102 "GET /compute/v2.1/servers/32e82b5a-f25b-413e-88a3-cf20b4979955" status: 200 len: 1323 microversion: 2.1 time: 0.164627 May 26 16:56:21.744982 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 542/1075] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:56:21 2022] GET /compute/v2.1/servers/32e82b5a-f25b-413e-88a3-cf20b4979955 => generated 1323 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:22.762609 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-55b69740-1a2a-4611-8082-76a68f6c868b tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:22.763305 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-55b69740-1a2a-4611-8082-76a68f6c868b tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 32e82b5a-f25b-413e-88a3-cf20b4979955] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:22.770685 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-55b69740-1a2a-4611-8082-76a68f6c868b tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:22.771122 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-55b69740-1a2a-4611-8082-76a68f6c868b tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:22.771882 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-55b69740-1a2a-4611-8082-76a68f6c868b tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:22.772315 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-55b69740-1a2a-4611-8082-76a68f6c868b tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:22.899549 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-55b69740-1a2a-4611-8082-76a68f6c868b tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427f3ca9698842b594bd2ca32f575013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40687185a3f94a849d65a09026ea119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:22.907106 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-55b69740-1a2a-4611-8082-76a68f6c868b tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] 10.222.0.102 "GET /compute/v2.1/servers/32e82b5a-f25b-413e-88a3-cf20b4979955" status: 200 len: 1323 microversion: 2.1 time: 0.148609 May 26 16:56:22.907664 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 534/1076] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:56:22 2022] GET /compute/v2.1/servers/32e82b5a-f25b-413e-88a3-cf20b4979955 => generated 1323 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:23.924504 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-24934174-acb6-41fd-a935-040ab9c83764 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:23.925040 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-24934174-acb6-41fd-a935-040ab9c83764 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 32e82b5a-f25b-413e-88a3-cf20b4979955] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:23.927937 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:23.928711 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=6 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:23.935058 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-24934174-acb6-41fd-a935-040ab9c83764 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:23.935500 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-24934174-acb6-41fd-a935-040ab9c83764 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:23.936251 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-24934174-acb6-41fd-a935-040ab9c83764 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:23.936710 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-24934174-acb6-41fd-a935-040ab9c83764 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:24.067611 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-24934174-acb6-41fd-a935-040ab9c83764 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427f3ca9698842b594bd2ca32f575013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40687185a3f94a849d65a09026ea119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:24.075057 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-24934174-acb6-41fd-a935-040ab9c83764 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] 10.222.0.102 "GET /compute/v2.1/servers/32e82b5a-f25b-413e-88a3-cf20b4979955" status: 200 len: 1512 microversion: 2.1 time: 0.154536 May 26 16:56:24.075628 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 543/1077] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:56:23 2022] GET /compute/v2.1/servers/32e82b5a-f25b-413e-88a3-cf20b4979955 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:24.091213 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-7b16ef11-baf3-454f-a85b-9bcff6dbf9f2 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d04c8b2-019a-4ada-a005-061c0b441238", "device": "/dev/sdb"}} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:56:24.092304 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-7b16ef11-baf3-454f-a85b-9bcff6dbf9f2 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 32e82b5a-f25b-413e-88a3-cf20b4979955] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:24.094328 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell0:SELECT=2 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:24.100593 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7b16ef11-baf3-454f-a85b-9bcff6dbf9f2 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:24.101038 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7b16ef11-baf3-454f-a85b-9bcff6dbf9f2 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:24.101806 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7b16ef11-baf3-454f-a85b-9bcff6dbf9f2 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:24.102241 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7b16ef11-baf3-454f-a85b-9bcff6dbf9f2 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:24.378637 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-7b16ef11-baf3-454f-a85b-9bcff6dbf9f2 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] 10.222.0.102 "POST /compute/v2.1/servers/32e82b5a-f25b-413e-88a3-cf20b4979955/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291195 May 26 16:56:24.379282 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 535/1078] 10.222.0.102 () {60 vars in 1327 bytes} [Thu May 26 16:56:24 2022] POST /compute/v2.1/servers/32e82b5a-f25b-413e-88a3-cf20b4979955/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:56:48.804043 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-67837a0b-ce7a-4777-88f9-d57112971ee8 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:48.804683 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-67837a0b-ce7a-4777-88f9-d57112971ee8 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 32e82b5a-f25b-413e-88a3-cf20b4979955] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:48.806652 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:48.807405 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=34 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:48.813538 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-67837a0b-ce7a-4777-88f9-d57112971ee8 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:48.813981 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-67837a0b-ce7a-4777-88f9-d57112971ee8 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:48.814745 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-67837a0b-ce7a-4777-88f9-d57112971ee8 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:48.815178 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-67837a0b-ce7a-4777-88f9-d57112971ee8 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:48.897747 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.objects.instance [None req-67837a0b-ce7a-4777-88f9-d57112971ee8 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lazy-loading 'services' on Instance uuid 32e82b5a-f25b-413e-88a3-cf20b4979955 {{(pid=124266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:56:48.971061 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-67837a0b-ce7a-4777-88f9-d57112971ee8 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] 10.222.0.102 "DELETE /compute/v2.1/servers/32e82b5a-f25b-413e-88a3-cf20b4979955/os-volume_attachments/8d04c8b2-019a-4ada-a005-061c0b441238" status: 202 len: 0 microversion: 2.1 time: 0.170664 May 26 16:56:48.971665 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 544/1079] 10.222.0.102 () {58 vars in 1420 bytes} [Thu May 26 16:56:48 2022] DELETE /compute/v2.1/servers/32e82b5a-f25b-413e-88a3-cf20b4979955/os-volume_attachments/8d04c8b2-019a-4ada-a005-061c0b441238 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 16:56:50.087984 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-ec1e9a05-49d9-4764-86de-f5ea30b63463 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:50.088683 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-ec1e9a05-49d9-4764-86de-f5ea30b63463 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 32e82b5a-f25b-413e-88a3-cf20b4979955] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:50.091103 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_api:SELECT=16 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:50.091849 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:50.097634 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ec1e9a05-49d9-4764-86de-f5ea30b63463 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:50.098810 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ec1e9a05-49d9-4764-86de-f5ea30b63463 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:50.099649 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ec1e9a05-49d9-4764-86de-f5ea30b63463 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:50.100033 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ec1e9a05-49d9-4764-86de-f5ea30b63463 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:50.125280 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-ec1e9a05-49d9-4764-86de-f5ea30b63463 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 32e82b5a-f25b-413e-88a3-cf20b4979955] Going to try to terminate instance {{(pid=124267) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 16:56:50.197978 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-ec1e9a05-49d9-4764-86de-f5ea30b63463 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] 10.222.0.102 "DELETE /compute/v2.1/servers/32e82b5a-f25b-413e-88a3-cf20b4979955" status: 204 len: 0 microversion: 2.1 time: 0.113978 May 26 16:56:50.198565 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 536/1080] 10.222.0.102 () {58 vars in 1243 bytes} [Thu May 26 16:56:50 2022] DELETE /compute/v2.1/servers/32e82b5a-f25b-413e-88a3-cf20b4979955 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 16:56:50.208534 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-af1f5c95-514e-4124-90cd-34df29aac3d2 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:50.209886 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-af1f5c95-514e-4124-90cd-34df29aac3d2 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 32e82b5a-f25b-413e-88a3-cf20b4979955] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:50.216822 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-af1f5c95-514e-4124-90cd-34df29aac3d2 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:50.217278 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-af1f5c95-514e-4124-90cd-34df29aac3d2 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:50.218055 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-af1f5c95-514e-4124-90cd-34df29aac3d2 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:50.218688 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-af1f5c95-514e-4124-90cd-34df29aac3d2 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:50.353058 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-af1f5c95-514e-4124-90cd-34df29aac3d2 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427f3ca9698842b594bd2ca32f575013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40687185a3f94a849d65a09026ea119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:50.360505 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-af1f5c95-514e-4124-90cd-34df29aac3d2 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] 10.222.0.102 "GET /compute/v2.1/servers/32e82b5a-f25b-413e-88a3-cf20b4979955" status: 200 len: 1518 microversion: 2.1 time: 0.157256 May 26 16:56:50.361082 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 545/1081] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:56:50 2022] GET /compute/v2.1/servers/32e82b5a-f25b-413e-88a3-cf20b4979955 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:51.378179 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-e290159c-1950-4246-a95e-f31ffdaa62af tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:51.378884 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-e290159c-1950-4246-a95e-f31ffdaa62af tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 32e82b5a-f25b-413e-88a3-cf20b4979955] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:51.385507 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e290159c-1950-4246-a95e-f31ffdaa62af tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:51.385967 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e290159c-1950-4246-a95e-f31ffdaa62af tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:51.386735 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e290159c-1950-4246-a95e-f31ffdaa62af tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:51.387176 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e290159c-1950-4246-a95e-f31ffdaa62af tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:51.518627 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-e290159c-1950-4246-a95e-f31ffdaa62af tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427f3ca9698842b594bd2ca32f575013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40687185a3f94a849d65a09026ea119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:51.526687 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-e290159c-1950-4246-a95e-f31ffdaa62af tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] 10.222.0.102 "GET /compute/v2.1/servers/32e82b5a-f25b-413e-88a3-cf20b4979955" status: 200 len: 1518 microversion: 2.1 time: 0.152806 May 26 16:56:51.527248 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 537/1082] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:56:51 2022] GET /compute/v2.1/servers/32e82b5a-f25b-413e-88a3-cf20b4979955 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:52.543569 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7e797278-1659-4077-a9df-40d1df04cc87 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:52.544172 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-7e797278-1659-4077-a9df-40d1df04cc87 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 32e82b5a-f25b-413e-88a3-cf20b4979955] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:52.550727 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7e797278-1659-4077-a9df-40d1df04cc87 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:52.551286 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7e797278-1659-4077-a9df-40d1df04cc87 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:52.552659 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7e797278-1659-4077-a9df-40d1df04cc87 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:52.553126 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7e797278-1659-4077-a9df-40d1df04cc87 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:52.760797 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7e797278-1659-4077-a9df-40d1df04cc87 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427f3ca9698842b594bd2ca32f575013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40687185a3f94a849d65a09026ea119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:52.768193 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7e797278-1659-4077-a9df-40d1df04cc87 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] 10.222.0.102 "GET /compute/v2.1/servers/32e82b5a-f25b-413e-88a3-cf20b4979955" status: 200 len: 1518 microversion: 2.1 time: 0.228582 May 26 16:56:52.768784 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 546/1083] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:56:52 2022] GET /compute/v2.1/servers/32e82b5a-f25b-413e-88a3-cf20b4979955 => generated 1518 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:53.021353 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-0306f5b3-77e9-4954-bba3-4f4713f00053 req-1d8f3957-22c4-4e40-bf4b-38ed15e8a084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32e82b5a-f25b-413e-88a3-cf20b4979955", "name": "network-vif-deleted", "tag": "5cf5bca7-b167-4637-871d-74fbe13ee8e0"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:56:53.033220 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-0306f5b3-77e9-4954-bba3-4f4713f00053 req-1d8f3957-22c4-4e40-bf4b-38ed15e8a084 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:53.033738 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-0306f5b3-77e9-4954-bba3-4f4713f00053 req-1d8f3957-22c4-4e40-bf4b-38ed15e8a084 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:53.046225 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-0306f5b3-77e9-4954-bba3-4f4713f00053 req-1d8f3957-22c4-4e40-bf4b-38ed15e8a084 service nova] Creating event network-vif-deleted:5cf5bca7-b167-4637-871d-74fbe13ee8e0 for instance 32e82b5a-f25b-413e-88a3-cf20b4979955 on hv-cinder-83607 May 26 16:56:53.052347 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-0306f5b3-77e9-4954-bba3-4f4713f00053 req-1d8f3957-22c4-4e40-bf4b-38ed15e8a084 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033754 May 26 16:56:53.053100 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 538/1084] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:56:53.786854 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-aeee2a46-b691-4fe3-8f2d-044dd30586c7 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:53.787970 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-aeee2a46-b691-4fe3-8f2d-044dd30586c7 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] [instance: 32e82b5a-f25b-413e-88a3-cf20b4979955] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:53.794489 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-aeee2a46-b691-4fe3-8f2d-044dd30586c7 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:53.794949 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-aeee2a46-b691-4fe3-8f2d-044dd30586c7 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:53.795731 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-aeee2a46-b691-4fe3-8f2d-044dd30586c7 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:53.796182 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-aeee2a46-b691-4fe3-8f2d-044dd30586c7 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:53.810719 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-aeee2a46-b691-4fe3-8f2d-044dd30586c7 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] HTTP exception thrown: Instance 32e82b5a-f25b-413e-88a3-cf20b4979955 could not be found. May 26 16:56:53.812390 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-aeee2a46-b691-4fe3-8f2d-044dd30586c7 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Request method failure captured: May 26 16:56:53.812390 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/servers/32e82b5a-f25b-413e-88a3-cf20b4979955 HTTP/1.1 May 26 16:56:53.812390 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept: application/json May 26 16:56:53.812390 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity May 26 16:56:53.812390 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Connection: close May 26 16:56:53.812390 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Length: 0 May 26 16:56:53.812390 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Type: application/json May 26 16:56:53.812390 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Host: 10.222.0.102 May 26 16:56:53.812390 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None May 26 16:56:53.812390 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 May 26 16:56:53.812390 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABij7DP6I_z6Q9ph9z-494b9W4TsCJ9vYjyHV3Qq1rO406I3YBas9RBWWW-BWs5nRk41LZ_pM2sRhKi3F9E2LTdP9fvd__PaYN4o1e4Wog_OFMgIoTFw82VUtgXHg0g4BS5X00cAKSts9VG2IKTmtk9tJu2FaJcKzz23-0SUN1atzkcb1Y May 26 16:56:53.812390 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Id: None May 26 16:56:53.812390 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Name: None May 26 16:56:53.812390 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed May 26 16:56:53.812390 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True May 26 16:56:53.812390 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default May 26 16:56:53.812390 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default May 26 16:56:53.812390 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Id: 40687185a3f94a849d65a09026ea119c May 26 16:56:53.812390 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1701105710 May 26 16:56:53.812390 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Role: reader,member May 26 16:56:53.812390 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Roles: reader,member May 26 16:56:53.813919 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/40687185a3f94a849d65a09026ea119c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/40687185a3f94a849d65a09026ea119c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/40687185a3f94a849d65a09026ea119c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_40687185a3f94a849d65a09026ea119c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:56:53.813919 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-VolumesSnapshotTestJSON-1701105710 May 26 16:56:53.813919 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Id: 40687185a3f94a849d65a09026ea119c May 26 16:56:53.813919 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1701105710 May 26 16:56:53.813919 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User: tempest-VolumesSnapshotTestJSON-1701105710-project May 26 16:56:53.813919 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default May 26 16:56:53.813919 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default May 26 16:56:53.813919 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Id: 427f3ca9698842b594bd2ca32f575013 May 26 16:56:53.813919 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-VolumesSnapshotTestJSON-1701105710-project May 26 16:56:53.813919 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: method: > May 26 16:56:53.813919 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: exception: Instance 32e82b5a-f25b-413e-88a3-cf20b4979955 could not be found. May 26 16:56:53.813919 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: action_args: {'id': '32e82b5a-f25b-413e-88a3-cf20b4979955'} May 26 16:56:53.814743 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:56:53.814743 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:56:53.814743 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:56:53.814743 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:56:53.814743 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:56:53.814743 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:56:53.814743 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:56:53.814743 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:56:53.814743 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:56:53.814743 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:56:53.814743 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32e82b5a-f25b-413e-88a3-cf20b4979955 could not be found. May 26 16:56:53.814743 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:56:53.814743 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:56:53.814743 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:56:53.814743 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:56:53.814743 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:56:53.814743 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:56:53.814743 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:56:53.814743 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:56:53.814743 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:56:53.816083 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:56:53.816083 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 16:56:53.816083 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 16:56:53.816083 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:56:53.816083 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:56:53.816083 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:56:53.816083 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:56:53.816083 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32e82b5a-f25b-413e-88a3-cf20b4979955 could not be found. May 26 16:56:53.816083 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:56:53.816083 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:56:53.816083 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:56:53.816083 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:56:53.816083 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:56:53.816083 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:56:53.816083 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:56:53.816083 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:56:53.816083 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32e82b5a-f25b-413e-88a3-cf20b4979955 could not be found. May 26 16:56:53.816083 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:56:53.817890 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-aeee2a46-b691-4fe3-8f2d-044dd30586c7 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] Returning 404 to user: Instance 32e82b5a-f25b-413e-88a3-cf20b4979955 could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:56:53.817890 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-aeee2a46-b691-4fe3-8f2d-044dd30586c7 tempest-VolumesSnapshotTestJSON-1701105710 tempest-VolumesSnapshotTestJSON-1701105710-project] 10.222.0.102 "GET /compute/v2.1/servers/32e82b5a-f25b-413e-88a3-cf20b4979955" status: 404 len: 111 microversion: 2.1 time: 0.032001 May 26 16:56:53.817890 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 547/1085] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:56:53 2022] GET /compute/v2.1/servers/32e82b5a-f25b-413e-88a3-cf20b4979955 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 16:57:12.256511 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-e568565a-35af-4dc0-b68b-31975a3989c5 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1238456734", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-902784053", "security_groups": [{"name": "tempest-secgroup-smoke-647515624"}], "block_device_mapping_v2": [{"uuid": "f08a56da-5823-4ed3-ad7f-943b2311e009", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c1d12c9f-73ed-437d-b2a9-5cffbb8cbe3e"}]}} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:57:12.265207 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:12.265853 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:12.375440 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.network.neutron [None req-e568565a-35af-4dc0-b68b-31975a3989c5 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] validate_networks() for [('c1d12c9f-73ed-437d-b2a9-5cffbb8cbe3e', None, None, None, None, None)] {{(pid=124267) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:57:12.787258 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-e568565a-35af-4dc0-b68b-31975a3989c5 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Flavor limits 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:57:12.787682 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-e568565a-35af-4dc0-b68b-31975a3989c5 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Image limits 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:57:12.788154 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-e568565a-35af-4dc0-b68b-31975a3989c5 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Flavor pref 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:57:12.788601 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-e568565a-35af-4dc0-b68b-31975a3989c5 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Image pref 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:57:12.789014 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-e568565a-35af-4dc0-b68b-31975a3989c5 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:57:12.798405 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e568565a-35af-4dc0-b68b-31975a3989c5 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:12.798858 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e568565a-35af-4dc0-b68b-31975a3989c5 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:12.799655 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e568565a-35af-4dc0-b68b-31975a3989c5 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:12.800096 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e568565a-35af-4dc0-b68b-31975a3989c5 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:12.818165 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.quota [None req-e568565a-35af-4dc0-b68b-31975a3989c5 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Getting quotas for project 257f08cba99b478db51729bf108ec901. Resources: {'cores', 'instances', 'ram'} {{(pid=124267) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:57:12.822155 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.quota [None req-e568565a-35af-4dc0-b68b-31975a3989c5 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Getting quotas for user 6f7a1fe832af4c83b4b969729d0721e9 and project 257f08cba99b478db51729bf108ec901. Resources: {'cores', 'instances', 'ram'} {{(pid=124267) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:57:12.881180 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-e568565a-35af-4dc0-b68b-31975a3989c5 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Going to run 1 instances... {{(pid=124267) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:57:12.883420 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-e568565a-35af-4dc0-b68b-31975a3989c5 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: bf9c9c4c-8480-4bcd-bebb-755535668e7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f08a56da-5823-4ed3-ad7f-943b2311e009',volume_size=None,volume_type=None)] {{(pid=124267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:57:13.009845 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-e568565a-35af-4dc0-b68b-31975a3989c5 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.758362 May 26 16:57:13.010493 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 539/1086] 10.222.0.102 () {60 vars in 1151 bytes} [Thu May 26 16:57:12 2022] POST /compute/v2.1/servers => generated 407 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 16:57:13.021300 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d14ed4dd-f103-442e-b295-ff13fe881d5d tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:13.022023 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d14ed4dd-f103-442e-b295-ff13fe881d5d tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: bf9c9c4c-8480-4bcd-bebb-755535668e7b] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:13.024618 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=8 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:13.025269 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:13.083187 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d14ed4dd-f103-442e-b295-ff13fe881d5d tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:13.098278 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d14ed4dd-f103-442e-b295-ff13fe881d5d tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b" status: 200 len: 1097 microversion: 2.1 time: 0.081423 May 26 16:57:13.098854 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 548/1087] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:57:13 2022] GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b => generated 1097 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:14.116229 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-e4c95aa7-b6ae-4483-8d27-a99b8ba6a0d9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:14.117170 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-e4c95aa7-b6ae-4483-8d27-a99b8ba6a0d9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: bf9c9c4c-8480-4bcd-bebb-755535668e7b] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:14.125533 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e4c95aa7-b6ae-4483-8d27-a99b8ba6a0d9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:14.126123 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e4c95aa7-b6ae-4483-8d27-a99b8ba6a0d9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:14.126998 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e4c95aa7-b6ae-4483-8d27-a99b8ba6a0d9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:14.128218 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e4c95aa7-b6ae-4483-8d27-a99b8ba6a0d9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:14.203230 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-e4c95aa7-b6ae-4483-8d27-a99b8ba6a0d9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:14.211810 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-e4c95aa7-b6ae-4483-8d27-a99b8ba6a0d9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b" status: 200 len: 1213 microversion: 2.1 time: 0.099897 May 26 16:57:14.212539 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 540/1088] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:57:14 2022] GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b => generated 1213 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:15.228676 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ec2327a0-d3ee-4b65-90c7-cfeae37cdfa6 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:15.229239 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ec2327a0-d3ee-4b65-90c7-cfeae37cdfa6 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: bf9c9c4c-8480-4bcd-bebb-755535668e7b] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:15.235496 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ec2327a0-d3ee-4b65-90c7-cfeae37cdfa6 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:15.235946 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ec2327a0-d3ee-4b65-90c7-cfeae37cdfa6 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:15.236784 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ec2327a0-d3ee-4b65-90c7-cfeae37cdfa6 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:15.237300 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ec2327a0-d3ee-4b65-90c7-cfeae37cdfa6 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:15.454712 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ec2327a0-d3ee-4b65-90c7-cfeae37cdfa6 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:15.462735 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ec2327a0-d3ee-4b65-90c7-cfeae37cdfa6 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b" status: 200 len: 1268 microversion: 2.1 time: 0.238063 May 26 16:57:15.463608 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 549/1089] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:57:15 2022] GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b => generated 1268 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:15.980716 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-0563a2de-0b8c-40c7-98e1-dee092e83d0d req-5cd6eb68-be8e-41a0-b88c-38b61810371d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf9c9c4c-8480-4bcd-bebb-755535668e7b", "tag": "f5293931-bd02-4f73-80b1-b2d73ca2f6c3"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:57:15.994249 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-0563a2de-0b8c-40c7-98e1-dee092e83d0d req-5cd6eb68-be8e-41a0-b88c-38b61810371d service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:15.994700 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-0563a2de-0b8c-40c7-98e1-dee092e83d0d req-5cd6eb68-be8e-41a0-b88c-38b61810371d service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:16.007302 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-0563a2de-0b8c-40c7-98e1-dee092e83d0d req-5cd6eb68-be8e-41a0-b88c-38b61810371d service nova] Creating event network-changed:f5293931-bd02-4f73-80b1-b2d73ca2f6c3 for instance bf9c9c4c-8480-4bcd-bebb-755535668e7b on hv-cinder-83607 May 26 16:57:16.020902 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-0563a2de-0b8c-40c7-98e1-dee092e83d0d req-5cd6eb68-be8e-41a0-b88c-38b61810371d service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048573 May 26 16:57:16.021630 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 541/1090] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:57:16.480341 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-e0a6fe9e-c771-4e51-938e-40851db57885 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:16.480995 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-e0a6fe9e-c771-4e51-938e-40851db57885 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: bf9c9c4c-8480-4bcd-bebb-755535668e7b] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:16.487700 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e0a6fe9e-c771-4e51-938e-40851db57885 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:16.488905 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e0a6fe9e-c771-4e51-938e-40851db57885 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:16.488905 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e0a6fe9e-c771-4e51-938e-40851db57885 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:16.488905 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-e0a6fe9e-c771-4e51-938e-40851db57885 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:16.623994 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-e0a6fe9e-c771-4e51-938e-40851db57885 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:16.631556 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-e0a6fe9e-c771-4e51-938e-40851db57885 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b" status: 200 len: 1268 microversion: 2.1 time: 0.155169 May 26 16:57:16.632128 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 550/1091] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:57:16 2022] GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:17.648831 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-e4ec54da-14bd-4d28-bedc-0c78d02d318c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:17.649436 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-e4ec54da-14bd-4d28-bedc-0c78d02d318c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: bf9c9c4c-8480-4bcd-bebb-755535668e7b] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:17.656345 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e4ec54da-14bd-4d28-bedc-0c78d02d318c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:17.656818 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e4ec54da-14bd-4d28-bedc-0c78d02d318c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:17.657583 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e4ec54da-14bd-4d28-bedc-0c78d02d318c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:17.658012 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-e4ec54da-14bd-4d28-bedc-0c78d02d318c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:17.790098 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-e4ec54da-14bd-4d28-bedc-0c78d02d318c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:17.797671 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-e4ec54da-14bd-4d28-bedc-0c78d02d318c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b" status: 200 len: 1268 microversion: 2.1 time: 0.153100 May 26 16:57:17.798263 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 542/1092] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:57:17 2022] GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:18.814556 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-74ae167e-e440-4b23-ac12-fcc7efadb9a8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:18.815159 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-74ae167e-e440-4b23-ac12-fcc7efadb9a8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: bf9c9c4c-8480-4bcd-bebb-755535668e7b] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:18.822197 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-74ae167e-e440-4b23-ac12-fcc7efadb9a8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:18.822648 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-74ae167e-e440-4b23-ac12-fcc7efadb9a8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:18.823427 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-74ae167e-e440-4b23-ac12-fcc7efadb9a8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:18.823867 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-74ae167e-e440-4b23-ac12-fcc7efadb9a8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:18.967548 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-74ae167e-e440-4b23-ac12-fcc7efadb9a8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:18.975531 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-74ae167e-e440-4b23-ac12-fcc7efadb9a8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b" status: 200 len: 1268 microversion: 2.1 time: 0.164837 May 26 16:57:18.976109 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 551/1093] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:57:18 2022] GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b => generated 1268 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:19.993152 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-08548c89-9c38-427c-b298-9ecbe90d2f21 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:19.993796 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-08548c89-9c38-427c-b298-9ecbe90d2f21 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: bf9c9c4c-8480-4bcd-bebb-755535668e7b] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:20.000365 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-08548c89-9c38-427c-b298-9ecbe90d2f21 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:20.000846 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-08548c89-9c38-427c-b298-9ecbe90d2f21 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:20.001619 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-08548c89-9c38-427c-b298-9ecbe90d2f21 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:20.002065 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-08548c89-9c38-427c-b298-9ecbe90d2f21 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:20.136433 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-08548c89-9c38-427c-b298-9ecbe90d2f21 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:20.143823 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-08548c89-9c38-427c-b298-9ecbe90d2f21 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b" status: 200 len: 1268 microversion: 2.1 time: 0.155119 May 26 16:57:20.144400 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 543/1094] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:57:19 2022] GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:21.160439 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-aaa6ff92-aadd-44d7-8a43-e6ad79e618d9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:21.161076 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-aaa6ff92-aadd-44d7-8a43-e6ad79e618d9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: bf9c9c4c-8480-4bcd-bebb-755535668e7b] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:21.167519 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-aaa6ff92-aadd-44d7-8a43-e6ad79e618d9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:21.167968 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-aaa6ff92-aadd-44d7-8a43-e6ad79e618d9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:21.168770 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-aaa6ff92-aadd-44d7-8a43-e6ad79e618d9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:21.169214 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-aaa6ff92-aadd-44d7-8a43-e6ad79e618d9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:21.307017 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-aaa6ff92-aadd-44d7-8a43-e6ad79e618d9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:21.314853 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-aaa6ff92-aadd-44d7-8a43-e6ad79e618d9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b" status: 200 len: 1268 microversion: 2.1 time: 0.158255 May 26 16:57:21.315476 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 552/1095] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:57:21 2022] GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:22.331673 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-6b66530d-ae13-4d45-813e-c3dd5bfef436 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:22.333836 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-6b66530d-ae13-4d45-813e-c3dd5bfef436 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: bf9c9c4c-8480-4bcd-bebb-755535668e7b] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:22.341092 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-6b66530d-ae13-4d45-813e-c3dd5bfef436 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:22.341535 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-6b66530d-ae13-4d45-813e-c3dd5bfef436 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:22.342553 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-6b66530d-ae13-4d45-813e-c3dd5bfef436 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:22.342992 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-6b66530d-ae13-4d45-813e-c3dd5bfef436 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:22.554301 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-6b66530d-ae13-4d45-813e-c3dd5bfef436 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:22.562447 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-6b66530d-ae13-4d45-813e-c3dd5bfef436 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b" status: 200 len: 1268 microversion: 2.1 time: 0.235014 May 26 16:57:22.563031 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 544/1096] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:57:22 2022] GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b => generated 1268 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:23.581633 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0f56e81d-2c0c-43dd-b7fb-5daa0682e6c9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:23.582278 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0f56e81d-2c0c-43dd-b7fb-5daa0682e6c9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: bf9c9c4c-8480-4bcd-bebb-755535668e7b] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:23.584700 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:23.590785 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0f56e81d-2c0c-43dd-b7fb-5daa0682e6c9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:23.591426 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0f56e81d-2c0c-43dd-b7fb-5daa0682e6c9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:23.592006 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0f56e81d-2c0c-43dd-b7fb-5daa0682e6c9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:23.592493 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0f56e81d-2c0c-43dd-b7fb-5daa0682e6c9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:23.732865 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0f56e81d-2c0c-43dd-b7fb-5daa0682e6c9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:23.740508 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0f56e81d-2c0c-43dd-b7fb-5daa0682e6c9 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b" status: 200 len: 1268 microversion: 2.1 time: 0.162636 May 26 16:57:23.741085 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 553/1097] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:57:23 2022] GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:24.757690 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-83d230e4-0cfa-4e55-8d54-6341a0e7d5c8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:24.758304 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-83d230e4-0cfa-4e55-8d54-6341a0e7d5c8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: bf9c9c4c-8480-4bcd-bebb-755535668e7b] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:24.760315 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell0:SELECT=2 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:24.761009 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell0:SELECT=6 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:24.768739 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-83d230e4-0cfa-4e55-8d54-6341a0e7d5c8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:24.769198 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-83d230e4-0cfa-4e55-8d54-6341a0e7d5c8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:24.770096 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-83d230e4-0cfa-4e55-8d54-6341a0e7d5c8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:24.771166 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-83d230e4-0cfa-4e55-8d54-6341a0e7d5c8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:24.907375 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-83d230e4-0cfa-4e55-8d54-6341a0e7d5c8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:24.914869 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-83d230e4-0cfa-4e55-8d54-6341a0e7d5c8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b" status: 200 len: 1268 microversion: 2.1 time: 0.161495 May 26 16:57:24.915430 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 545/1098] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:57:24 2022] GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:25.931661 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d2d64540-4c5c-4d2d-817d-a5ee72d1dc12 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:25.932277 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d2d64540-4c5c-4d2d-817d-a5ee72d1dc12 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: bf9c9c4c-8480-4bcd-bebb-755535668e7b] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:25.938966 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d2d64540-4c5c-4d2d-817d-a5ee72d1dc12 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:25.939420 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d2d64540-4c5c-4d2d-817d-a5ee72d1dc12 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:25.940194 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d2d64540-4c5c-4d2d-817d-a5ee72d1dc12 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:25.940665 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d2d64540-4c5c-4d2d-817d-a5ee72d1dc12 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:26.074154 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d2d64540-4c5c-4d2d-817d-a5ee72d1dc12 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:26.081758 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d2d64540-4c5c-4d2d-817d-a5ee72d1dc12 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b" status: 200 len: 1268 microversion: 2.1 time: 0.154091 May 26 16:57:26.082589 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 554/1099] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:57:25 2022] GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:27.101837 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-1eadb529-1fe2-494f-8de0-28fa78fbda7a tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:27.102476 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-1eadb529-1fe2-494f-8de0-28fa78fbda7a tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: bf9c9c4c-8480-4bcd-bebb-755535668e7b] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:27.109091 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1eadb529-1fe2-494f-8de0-28fa78fbda7a tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:27.109549 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1eadb529-1fe2-494f-8de0-28fa78fbda7a tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:27.110322 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1eadb529-1fe2-494f-8de0-28fa78fbda7a tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:27.110765 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1eadb529-1fe2-494f-8de0-28fa78fbda7a tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:27.248829 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-1eadb529-1fe2-494f-8de0-28fa78fbda7a tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:27.256322 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-1eadb529-1fe2-494f-8de0-28fa78fbda7a tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b" status: 200 len: 1268 microversion: 2.1 time: 0.160515 May 26 16:57:27.256914 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 546/1100] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:57:27 2022] GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:28.274570 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-953caed7-c95b-4813-ba19-2a1176aaa4e8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:28.275174 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-953caed7-c95b-4813-ba19-2a1176aaa4e8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: bf9c9c4c-8480-4bcd-bebb-755535668e7b] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:28.281738 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-953caed7-c95b-4813-ba19-2a1176aaa4e8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:28.282182 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-953caed7-c95b-4813-ba19-2a1176aaa4e8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:28.282937 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-953caed7-c95b-4813-ba19-2a1176aaa4e8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:28.283369 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-953caed7-c95b-4813-ba19-2a1176aaa4e8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:28.414953 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-953caed7-c95b-4813-ba19-2a1176aaa4e8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:28.422608 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-953caed7-c95b-4813-ba19-2a1176aaa4e8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b" status: 200 len: 1268 microversion: 2.1 time: 0.151909 May 26 16:57:28.423175 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 555/1101] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:57:28 2022] GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:29.441037 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-26d29e2a-b2a6-4924-a0eb-944c9dd0f932 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:29.441877 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-26d29e2a-b2a6-4924-a0eb-944c9dd0f932 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: bf9c9c4c-8480-4bcd-bebb-755535668e7b] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:29.448877 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-26d29e2a-b2a6-4924-a0eb-944c9dd0f932 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:29.449329 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-26d29e2a-b2a6-4924-a0eb-944c9dd0f932 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:29.450110 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-26d29e2a-b2a6-4924-a0eb-944c9dd0f932 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:29.450550 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-26d29e2a-b2a6-4924-a0eb-944c9dd0f932 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:29.583941 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-26d29e2a-b2a6-4924-a0eb-944c9dd0f932 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:29.591520 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-26d29e2a-b2a6-4924-a0eb-944c9dd0f932 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b" status: 200 len: 1268 microversion: 2.1 time: 0.155651 May 26 16:57:29.592089 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 547/1102] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:57:29 2022] GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:30.609046 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-834b51c7-85bc-4fc6-85ab-fc84e99bb29c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:30.609607 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-834b51c7-85bc-4fc6-85ab-fc84e99bb29c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: bf9c9c4c-8480-4bcd-bebb-755535668e7b] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:30.616239 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-834b51c7-85bc-4fc6-85ab-fc84e99bb29c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:30.616882 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-834b51c7-85bc-4fc6-85ab-fc84e99bb29c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:30.617654 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-834b51c7-85bc-4fc6-85ab-fc84e99bb29c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:30.618153 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-834b51c7-85bc-4fc6-85ab-fc84e99bb29c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:30.752490 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-834b51c7-85bc-4fc6-85ab-fc84e99bb29c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:30.760389 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-834b51c7-85bc-4fc6-85ab-fc84e99bb29c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b" status: 200 len: 1268 microversion: 2.1 time: 0.155460 May 26 16:57:30.760952 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 556/1103] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:57:30 2022] GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:31.777382 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-bc45ee61-d3bc-4dcd-82c5-ee65ba49cd91 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:31.778694 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-bc45ee61-d3bc-4dcd-82c5-ee65ba49cd91 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: bf9c9c4c-8480-4bcd-bebb-755535668e7b] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:31.785309 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bc45ee61-d3bc-4dcd-82c5-ee65ba49cd91 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:31.785986 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bc45ee61-d3bc-4dcd-82c5-ee65ba49cd91 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:31.787259 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bc45ee61-d3bc-4dcd-82c5-ee65ba49cd91 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:31.787696 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-bc45ee61-d3bc-4dcd-82c5-ee65ba49cd91 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:32.011051 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-bc45ee61-d3bc-4dcd-82c5-ee65ba49cd91 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:32.020078 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-bc45ee61-d3bc-4dcd-82c5-ee65ba49cd91 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b" status: 200 len: 1268 microversion: 2.1 time: 0.246530 May 26 16:57:32.021732 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 548/1104] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:57:31 2022] GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b => generated 1268 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:32.064725 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-7d0662db-de32-497e-b721-b48a39f6f5d0 req-5d133e06-416a-41d9-a02a-b3cc164edb4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf9c9c4c-8480-4bcd-bebb-755535668e7b", "name": "network-vif-plugged", "status": "completed", "tag": "f5293931-bd02-4f73-80b1-b2d73ca2f6c3"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:57:32.073124 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-7d0662db-de32-497e-b721-b48a39f6f5d0 req-5d133e06-416a-41d9-a02a-b3cc164edb4c service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:32.073630 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-7d0662db-de32-497e-b721-b48a39f6f5d0 req-5d133e06-416a-41d9-a02a-b3cc164edb4c service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:32.085081 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-7d0662db-de32-497e-b721-b48a39f6f5d0 req-5d133e06-416a-41d9-a02a-b3cc164edb4c service nova] Creating event network-vif-plugged:f5293931-bd02-4f73-80b1-b2d73ca2f6c3 for instance bf9c9c4c-8480-4bcd-bebb-755535668e7b on hv-cinder-83607 May 26 16:57:32.090072 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-7d0662db-de32-497e-b721-b48a39f6f5d0 req-5d133e06-416a-41d9-a02a-b3cc164edb4c service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103512 May 26 16:57:32.090651 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 557/1105] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:57:33.038030 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-a2d0766d-d00a-4718-abd3-98965323f5d5 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:33.038857 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-a2d0766d-d00a-4718-abd3-98965323f5d5 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: bf9c9c4c-8480-4bcd-bebb-755535668e7b] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:33.045373 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a2d0766d-d00a-4718-abd3-98965323f5d5 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:33.045828 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a2d0766d-d00a-4718-abd3-98965323f5d5 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:33.046601 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a2d0766d-d00a-4718-abd3-98965323f5d5 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:33.047040 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a2d0766d-d00a-4718-abd3-98965323f5d5 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:33.178103 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-a2d0766d-d00a-4718-abd3-98965323f5d5 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:33.185842 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-a2d0766d-d00a-4718-abd3-98965323f5d5 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b" status: 200 len: 1268 microversion: 2.1 time: 0.152707 May 26 16:57:33.186411 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 549/1106] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:57:33 2022] GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:57:34.202994 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f53bf467-d6ae-4723-b2aa-26d4791dc2b7 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:34.203694 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f53bf467-d6ae-4723-b2aa-26d4791dc2b7 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: bf9c9c4c-8480-4bcd-bebb-755535668e7b] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:34.209970 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f53bf467-d6ae-4723-b2aa-26d4791dc2b7 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:34.210423 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f53bf467-d6ae-4723-b2aa-26d4791dc2b7 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:34.211185 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f53bf467-d6ae-4723-b2aa-26d4791dc2b7 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:34.211615 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f53bf467-d6ae-4723-b2aa-26d4791dc2b7 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:34.346665 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f53bf467-d6ae-4723-b2aa-26d4791dc2b7 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:34.354257 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f53bf467-d6ae-4723-b2aa-26d4791dc2b7 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b" status: 200 len: 1268 microversion: 2.1 time: 0.155964 May 26 16:57:34.354858 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 558/1107] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:57:34 2022] GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:35.371215 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-336024e2-16ec-471d-b5dc-e49996bd1188 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:35.371819 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-336024e2-16ec-471d-b5dc-e49996bd1188 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: bf9c9c4c-8480-4bcd-bebb-755535668e7b] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:35.378473 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-336024e2-16ec-471d-b5dc-e49996bd1188 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:35.378928 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-336024e2-16ec-471d-b5dc-e49996bd1188 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:35.379725 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-336024e2-16ec-471d-b5dc-e49996bd1188 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:35.380692 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-336024e2-16ec-471d-b5dc-e49996bd1188 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:35.513077 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-336024e2-16ec-471d-b5dc-e49996bd1188 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:35.520661 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-336024e2-16ec-471d-b5dc-e49996bd1188 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b" status: 200 len: 1455 microversion: 2.1 time: 0.153331 May 26 16:57:35.521851 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 550/1108] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:57:35 2022] GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b => generated 1455 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:35.537212 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-dd573c88-8ba7-4d28-823b-a2b6fe53b917 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:35.537826 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-dd573c88-8ba7-4d28-823b-a2b6fe53b917 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: bf9c9c4c-8480-4bcd-bebb-755535668e7b] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:35.544394 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dd573c88-8ba7-4d28-823b-a2b6fe53b917 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:35.544863 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dd573c88-8ba7-4d28-823b-a2b6fe53b917 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:35.545626 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dd573c88-8ba7-4d28-823b-a2b6fe53b917 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:35.546061 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-dd573c88-8ba7-4d28-823b-a2b6fe53b917 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:35.678156 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-dd573c88-8ba7-4d28-823b-a2b6fe53b917 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:35.685973 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-dd573c88-8ba7-4d28-823b-a2b6fe53b917 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b" status: 200 len: 1455 microversion: 2.1 time: 0.152610 May 26 16:57:35.686539 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 559/1109] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:57:35 2022] GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b => generated 1455 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:37.488555 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-381a5eb6-4618-493c-b3d9-16881f6742e3 req-3da7b910-dcc7-4292-a0cf-e173ecc5fbd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf9c9c4c-8480-4bcd-bebb-755535668e7b", "tag": "f5293931-bd02-4f73-80b1-b2d73ca2f6c3"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:57:37.498177 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-381a5eb6-4618-493c-b3d9-16881f6742e3 req-3da7b910-dcc7-4292-a0cf-e173ecc5fbd8 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:37.498625 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-381a5eb6-4618-493c-b3d9-16881f6742e3 req-3da7b910-dcc7-4292-a0cf-e173ecc5fbd8 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:37.510422 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-381a5eb6-4618-493c-b3d9-16881f6742e3 req-3da7b910-dcc7-4292-a0cf-e173ecc5fbd8 service nova] Creating event network-changed:f5293931-bd02-4f73-80b1-b2d73ca2f6c3 for instance bf9c9c4c-8480-4bcd-bebb-755535668e7b on hv-cinder-83607 May 26 16:57:37.515667 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-381a5eb6-4618-493c-b3d9-16881f6742e3 req-3da7b910-dcc7-4292-a0cf-e173ecc5fbd8 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030843 May 26 16:57:37.516658 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 551/1110] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:57:58.846119 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 16:57:58.846840 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Thu May 26 16:57:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 16:58:05.356676 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=26 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:05.357398 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=62 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:05.519584 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-5228dd13-acbc-4c00-85cb-910af91133a8 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:05.520082 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-5228dd13-acbc-4c00-85cb-910af91133a8 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 97945b79-f060-4f05-aa03-9c46f87623ac] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:05.526360 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5228dd13-acbc-4c00-85cb-910af91133a8 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:05.526810 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5228dd13-acbc-4c00-85cb-910af91133a8 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:05.527616 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5228dd13-acbc-4c00-85cb-910af91133a8 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:05.528079 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5228dd13-acbc-4c00-85cb-910af91133a8 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:05.551099 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-5228dd13-acbc-4c00-85cb-910af91133a8 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac/ips" status: 200 len: 149 microversion: 2.1 time: 0.200214 May 26 16:58:05.551653 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 560/1111] 10.222.0.102 () {58 vars in 1252 bytes} [Thu May 26 16:58:05 2022] GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac/ips => generated 149 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:58:05.563819 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-7e40b90e-3a76-41de-9ebb-34e4c17870b0 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "961f5708-41cd-406c-bcf4-db34d9d0b0a3"}} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:58:05.564949 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-7e40b90e-3a76-41de-9ebb-34e4c17870b0 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 97945b79-f060-4f05-aa03-9c46f87623ac] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:05.566946 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:05.567576 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=66 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:05.574545 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7e40b90e-3a76-41de-9ebb-34e4c17870b0 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:05.574991 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7e40b90e-3a76-41de-9ebb-34e4c17870b0 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:05.575748 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7e40b90e-3a76-41de-9ebb-34e4c17870b0 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:05.576180 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7e40b90e-3a76-41de-9ebb-34e4c17870b0 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:05.658196 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.wsgi [None req-7e40b90e-3a76-41de-9ebb-34e4c17870b0 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] HTTP exception thrown: Invalid volume: volume 961f5708-41cd-406c-bcf4-db34d9d0b0a3 is already attached to instances: 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 May 26 16:58:05.659903 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-7e40b90e-3a76-41de-9ebb-34e4c17870b0 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Request method failure captured: May 26 16:58:05.659903 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: request: POST /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac/os-volume_attachments HTTP/1.1 May 26 16:58:05.659903 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept: application/json May 26 16:58:05.659903 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept-Encoding: identity May 26 16:58:05.659903 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Connection: close May 26 16:58:05.659903 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Length: 74 May 26 16:58:05.659903 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Type: application/json May 26 16:58:05.659903 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Host: 10.222.0.102 May 26 16:58:05.659903 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Openstack-System-Scope: None May 26 16:58:05.659903 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: User-Agent: python-urllib3/1.26.9 May 26 16:58:05.659903 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Auth-Token: gAAAAABij7BiyHwpXyrt5gouZdLSR2u247HLrYjemXZgQvKKvL_gKjh50uqCS18EIS9Fz-K4YX8tYAnNJ1wV14kiwAB02jbBtqzwSucC_mBuXxtMJigMQrPKQ8KbZZZS-Ddpdzpc4NsmLSF1WlBJg_r88uD0kjqGmk19u_c3hfGh7S_nxL5xe64 May 26 16:58:05.659903 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Id: None May 26 16:58:05.659903 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Name: None May 26 16:58:05.659903 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Identity-Status: Confirmed May 26 16:58:05.659903 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Is-Admin-Project: True May 26 16:58:05.659903 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Id: default May 26 16:58:05.659903 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Name: Default May 26 16:58:05.659903 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Id: c56b7ca2b1f54ae782302bead8a35b01 May 26 16:58:05.659903 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Name: tempest-AttachVolumeNegativeTest-482187288 May 26 16:58:05.659903 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Role: reader,member May 26 16:58:05.659903 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Roles: reader,member May 26 16:58:05.661682 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:58:05.661682 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant: tempest-AttachVolumeNegativeTest-482187288 May 26 16:58:05.661682 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Id: c56b7ca2b1f54ae782302bead8a35b01 May 26 16:58:05.661682 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-482187288 May 26 16:58:05.661682 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User: tempest-AttachVolumeNegativeTest-482187288-project May 26 16:58:05.661682 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Id: default May 26 16:58:05.661682 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Name: Default May 26 16:58:05.661682 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Id: 75cc85261ad441f8993877a959bdd97b May 26 16:58:05.661682 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Name: tempest-AttachVolumeNegativeTest-482187288-project May 26 16:58:05.661682 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: May 26 16:58:05.661682 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: {"volumeAttachment": {"volumeId": "961f5708-41cd-406c-bcf4-db34d9d0b0a3"}} May 26 16:58:05.661682 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: method: > May 26 16:58:05.662713 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: exception: Invalid volume: volume 961f5708-41cd-406c-bcf4-db34d9d0b0a3 is already attached to instances: 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 May 26 16:58:05.662713 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: action_args: {'server_id': '97945b79-f060-4f05-aa03-9c46f87623ac', 'body': {'volumeAttachment': {'volumeId': '961f5708-41cd-406c-bcf4-db34d9d0b0a3'}}} May 26 16:58:05.662713 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:58:05.662713 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:58:05.662713 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 16:58:05.662713 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 16:58:05.662713 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 16:58:05.662713 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 16:58:05.662713 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 16:58:05.662713 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 16:58:05.662713 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 26 16:58:05.662713 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 26 16:58:05.662713 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 26 16:58:05.662713 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 26 16:58:05.662713 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 961f5708-41cd-406c-bcf4-db34d9d0b0a3 is already attached to instances: 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 May 26 16:58:05.662713 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:58:05.662713 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:58:05.662713 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:58:05.662713 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:58:05.664311 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:58:05.664311 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:58:05.664311 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:58:05.664311 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:58:05.664311 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:58:05.664311 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:58:05.664311 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 16:58:05.664311 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 16:58:05.664311 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 16:58:05.664311 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 16:58:05.664311 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 16:58:05.664311 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 16:58:05.664311 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 26 16:58:05.664311 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 16:58:05.664311 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 961f5708-41cd-406c-bcf4-db34d9d0b0a3 is already attached to instances: 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 May 26 16:58:05.664311 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:58:05.664311 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:58:05.664311 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:58:05.664311 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:58:05.664311 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:58:05.665928 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:58:05.665928 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:58:05.665928 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:58:05.665928 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 961f5708-41cd-406c-bcf4-db34d9d0b0a3 is already attached to instances: 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 May 26 16:58:05.665928 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:58:05.665928 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-7e40b90e-3a76-41de-9ebb-34e4c17870b0 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Returning 400 to user: Invalid volume: volume 961f5708-41cd-406c-bcf4-db34d9d0b0a3 is already attached to instances: 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 {{(pid=124267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:58:05.665928 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-7e40b90e-3a76-41de-9ebb-34e4c17870b0 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "POST /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103078 May 26 16:58:05.665928 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 552/1112] 10.222.0.102 () {60 vars in 1327 bytes} [Thu May 26 16:58:05 2022] POST /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 16:58:05.670308 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-3fb558fc-0753-4c8c-aa50-cf26999bf773 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:05.670810 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-3fb558fc-0753-4c8c-aa50-cf26999bf773 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 97945b79-f060-4f05-aa03-9c46f87623ac] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:05.676961 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3fb558fc-0753-4c8c-aa50-cf26999bf773 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:05.677419 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3fb558fc-0753-4c8c-aa50-cf26999bf773 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:05.678191 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3fb558fc-0753-4c8c-aa50-cf26999bf773 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:05.678634 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-3fb558fc-0753-4c8c-aa50-cf26999bf773 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:05.703679 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-3fb558fc-0753-4c8c-aa50-cf26999bf773 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 97945b79-f060-4f05-aa03-9c46f87623ac] Going to try to terminate instance {{(pid=124266) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 16:58:05.785886 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-3fb558fc-0753-4c8c-aa50-cf26999bf773 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "DELETE /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac" status: 204 len: 0 microversion: 2.1 time: 0.118955 May 26 16:58:05.786587 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 561/1113] 10.222.0.102 () {58 vars in 1243 bytes} [Thu May 26 16:58:05 2022] DELETE /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 16:58:05.795550 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-277359ce-e581-49de-ade9-d49ca712046f tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:05.796170 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-277359ce-e581-49de-ade9-d49ca712046f tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 97945b79-f060-4f05-aa03-9c46f87623ac] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:05.802355 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-277359ce-e581-49de-ade9-d49ca712046f tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:05.802810 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-277359ce-e581-49de-ade9-d49ca712046f tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:05.803580 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-277359ce-e581-49de-ade9-d49ca712046f tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:05.804015 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-277359ce-e581-49de-ade9-d49ca712046f tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:05.934414 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-277359ce-e581-49de-ade9-d49ca712046f tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:05.942195 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-277359ce-e581-49de-ade9-d49ca712046f tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac" status: 200 len: 1685 microversion: 2.1 time: 0.150819 May 26 16:58:05.942759 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 553/1114] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:58:05 2022] GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac => generated 1685 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:06.960530 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-09b99f6f-4ed8-41c7-962f-1e7308fafa04 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:06.961224 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-09b99f6f-4ed8-41c7-962f-1e7308fafa04 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 97945b79-f060-4f05-aa03-9c46f87623ac] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:06.967614 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-09b99f6f-4ed8-41c7-962f-1e7308fafa04 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:06.968058 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-09b99f6f-4ed8-41c7-962f-1e7308fafa04 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:06.968837 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-09b99f6f-4ed8-41c7-962f-1e7308fafa04 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:06.969271 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-09b99f6f-4ed8-41c7-962f-1e7308fafa04 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:07.106061 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-09b99f6f-4ed8-41c7-962f-1e7308fafa04 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:07.113708 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-09b99f6f-4ed8-41c7-962f-1e7308fafa04 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac" status: 200 len: 1685 microversion: 2.1 time: 0.157323 May 26 16:58:07.114284 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 562/1115] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:58:06 2022] GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:08.131355 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-b1c0190e-4ac1-4c44-b68b-8c485c9f3a5a tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:08.132104 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-b1c0190e-4ac1-4c44-b68b-8c485c9f3a5a tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 97945b79-f060-4f05-aa03-9c46f87623ac] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:08.139958 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b1c0190e-4ac1-4c44-b68b-8c485c9f3a5a tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:08.140449 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b1c0190e-4ac1-4c44-b68b-8c485c9f3a5a tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:08.141255 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b1c0190e-4ac1-4c44-b68b-8c485c9f3a5a tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:08.141697 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-b1c0190e-4ac1-4c44-b68b-8c485c9f3a5a tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:08.541293 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-b1c0190e-4ac1-4c44-b68b-8c485c9f3a5a tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:08.549396 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-b1c0190e-4ac1-4c44-b68b-8c485c9f3a5a tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac" status: 200 len: 1685 microversion: 2.1 time: 0.421968 May 26 16:58:08.550633 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 554/1116] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:58:08 2022] GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac => generated 1685 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:09.174392 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-c9c24b0f-ccbf-4e89-9b4f-fe4f806aad64 req-1e423c02-a608-4d8e-b491-e420181035c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97945b79-f060-4f05-aa03-9c46f87623ac", "name": "network-vif-deleted", "tag": "cfcbead4-c344-4ea7-8029-7b093ea3c8eb"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:58:09.185367 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-c9c24b0f-ccbf-4e89-9b4f-fe4f806aad64 req-1e423c02-a608-4d8e-b491-e420181035c0 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:09.186711 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-c9c24b0f-ccbf-4e89-9b4f-fe4f806aad64 req-1e423c02-a608-4d8e-b491-e420181035c0 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:09.199227 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-c9c24b0f-ccbf-4e89-9b4f-fe4f806aad64 req-1e423c02-a608-4d8e-b491-e420181035c0 service nova] Creating event network-vif-deleted:cfcbead4-c344-4ea7-8029-7b093ea3c8eb for instance 97945b79-f060-4f05-aa03-9c46f87623ac on hv-cinder-83607 May 26 16:58:09.205720 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-c9c24b0f-ccbf-4e89-9b4f-fe4f806aad64 req-1e423c02-a608-4d8e-b491-e420181035c0 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034766 May 26 16:58:09.206674 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 563/1117] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:58:09.567459 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-136540d0-8664-4847-b2b9-a71e9ad950a7 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:09.568212 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-136540d0-8664-4847-b2b9-a71e9ad950a7 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 97945b79-f060-4f05-aa03-9c46f87623ac] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:09.575423 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-136540d0-8664-4847-b2b9-a71e9ad950a7 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:09.575877 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-136540d0-8664-4847-b2b9-a71e9ad950a7 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:09.576691 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-136540d0-8664-4847-b2b9-a71e9ad950a7 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:09.577132 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-136540d0-8664-4847-b2b9-a71e9ad950a7 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:09.609716 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-136540d0-8664-4847-b2b9-a71e9ad950a7 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:09.610165 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-136540d0-8664-4847-b2b9-a71e9ad950a7 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:09.610615 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.objects.instance [None req-136540d0-8664-4847-b2b9-a71e9ad950a7 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lazy-loading 'fault' on Instance uuid 97945b79-f060-4f05-aa03-9c46f87623ac {{(pid=124267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:58:09.653825 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-136540d0-8664-4847-b2b9-a71e9ad950a7 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:09.661534 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-136540d0-8664-4847-b2b9-a71e9ad950a7 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac" status: 200 len: 1336 microversion: 2.1 time: 0.098015 May 26 16:58:09.662322 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 555/1118] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:58:09 2022] GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac => generated 1336 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:10.679611 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-32752f56-7412-46f9-8295-5466ef0b2749 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:10.680229 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-32752f56-7412-46f9-8295-5466ef0b2749 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 97945b79-f060-4f05-aa03-9c46f87623ac] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:10.687701 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-32752f56-7412-46f9-8295-5466ef0b2749 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:10.688154 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-32752f56-7412-46f9-8295-5466ef0b2749 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:10.688982 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-32752f56-7412-46f9-8295-5466ef0b2749 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:10.689422 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-32752f56-7412-46f9-8295-5466ef0b2749 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:10.703257 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-32752f56-7412-46f9-8295-5466ef0b2749 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] HTTP exception thrown: Instance 97945b79-f060-4f05-aa03-9c46f87623ac could not be found. May 26 16:58:10.704908 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-32752f56-7412-46f9-8295-5466ef0b2749 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Request method failure captured: May 26 16:58:10.704908 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac HTTP/1.1 May 26 16:58:10.704908 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept: application/json May 26 16:58:10.704908 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity May 26 16:58:10.704908 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Connection: close May 26 16:58:10.704908 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Length: 0 May 26 16:58:10.704908 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Type: application/json May 26 16:58:10.704908 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Host: 10.222.0.102 May 26 16:58:10.704908 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None May 26 16:58:10.704908 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 May 26 16:58:10.704908 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABij7BiyHwpXyrt5gouZdLSR2u247HLrYjemXZgQvKKvL_gKjh50uqCS18EIS9Fz-K4YX8tYAnNJ1wV14kiwAB02jbBtqzwSucC_mBuXxtMJigMQrPKQ8KbZZZS-Ddpdzpc4NsmLSF1WlBJg_r88uD0kjqGmk19u_c3hfGh7S_nxL5xe64 May 26 16:58:10.704908 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Id: None May 26 16:58:10.704908 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Name: None May 26 16:58:10.704908 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed May 26 16:58:10.704908 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True May 26 16:58:10.704908 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default May 26 16:58:10.704908 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default May 26 16:58:10.704908 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Id: c56b7ca2b1f54ae782302bead8a35b01 May 26 16:58:10.704908 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-AttachVolumeNegativeTest-482187288 May 26 16:58:10.704908 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Role: reader,member May 26 16:58:10.704908 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Roles: reader,member May 26 16:58:10.706511 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:58:10.706511 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-AttachVolumeNegativeTest-482187288 May 26 16:58:10.706511 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Id: c56b7ca2b1f54ae782302bead8a35b01 May 26 16:58:10.706511 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-482187288 May 26 16:58:10.706511 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User: tempest-AttachVolumeNegativeTest-482187288-project May 26 16:58:10.706511 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default May 26 16:58:10.706511 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default May 26 16:58:10.706511 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Id: 75cc85261ad441f8993877a959bdd97b May 26 16:58:10.706511 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-AttachVolumeNegativeTest-482187288-project May 26 16:58:10.706511 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: method: > May 26 16:58:10.706511 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: exception: Instance 97945b79-f060-4f05-aa03-9c46f87623ac could not be found. May 26 16:58:10.706511 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: action_args: {'id': '97945b79-f060-4f05-aa03-9c46f87623ac'} May 26 16:58:10.707352 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:58:10.707352 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:58:10.707352 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:58:10.707352 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:58:10.707352 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:58:10.707352 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:58:10.707352 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:58:10.707352 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:58:10.707352 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:58:10.707352 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:58:10.707352 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97945b79-f060-4f05-aa03-9c46f87623ac could not be found. May 26 16:58:10.707352 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:58:10.707352 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:58:10.707352 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:58:10.707352 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:58:10.707352 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:58:10.707352 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:58:10.707352 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:58:10.707352 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:58:10.707352 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:58:10.708902 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:58:10.708902 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 16:58:10.708902 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 16:58:10.708902 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:58:10.708902 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:58:10.708902 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:58:10.708902 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:58:10.708902 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97945b79-f060-4f05-aa03-9c46f87623ac could not be found. May 26 16:58:10.708902 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:58:10.708902 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:58:10.708902 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:58:10.708902 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:58:10.708902 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:58:10.708902 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:58:10.708902 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:58:10.708902 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:58:10.708902 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97945b79-f060-4f05-aa03-9c46f87623ac could not be found. May 26 16:58:10.708902 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:58:10.710246 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-32752f56-7412-46f9-8295-5466ef0b2749 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Returning 404 to user: Instance 97945b79-f060-4f05-aa03-9c46f87623ac could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:58:10.710246 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-32752f56-7412-46f9-8295-5466ef0b2749 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac" status: 404 len: 111 microversion: 2.1 time: 0.031004 May 26 16:58:10.710246 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 564/1119] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:58:10 2022] GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 16:58:10.715869 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-dd30cbb9-4f2a-4c1b-905a-17adb3919fc2 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '.version_select at 0x7f93b08ae3a0>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:10.739140 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-dd30cbb9-4f2a-4c1b-905a-17adb3919fc2 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2076032949" status: 202 len: 0 microversion: 2.1 time: 0.027577 May 26 16:58:10.740102 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 556/1120] 10.222.0.102 () {58 vars in 1225 bytes} [Thu May 26 16:58:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2076032949 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 16:58:11.383733 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-5d97471a-8a24-4d0b-921c-e8a8c6dc5633 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:11.384220 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-5d97471a-8a24-4d0b-921c-e8a8c6dc5633 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:11.390761 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5d97471a-8a24-4d0b-921c-e8a8c6dc5633 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:11.391202 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5d97471a-8a24-4d0b-921c-e8a8c6dc5633 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:11.391952 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5d97471a-8a24-4d0b-921c-e8a8c6dc5633 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:11.392409 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5d97471a-8a24-4d0b-921c-e8a8c6dc5633 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:11.473191 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.objects.instance [None req-5d97471a-8a24-4d0b-921c-e8a8c6dc5633 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lazy-loading 'services' on Instance uuid 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 {{(pid=124266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:58:11.547365 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-5d97471a-8a24-4d0b-921c-e8a8c6dc5633 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "DELETE /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3/os-volume_attachments/961f5708-41cd-406c-bcf4-db34d9d0b0a3" status: 202 len: 0 microversion: 2.1 time: 0.167359 May 26 16:58:11.548226 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 565/1121] 10.222.0.102 () {58 vars in 1420 bytes} [Thu May 26 16:58:11 2022] DELETE /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3/os-volume_attachments/961f5708-41cd-406c-bcf4-db34d9d0b0a3 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 16:58:11.557931 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-1e4b9514-db26-4cf1-95f2-58b9120e4112 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:11.559533 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-1e4b9514-db26-4cf1-95f2-58b9120e4112 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:11.567108 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1e4b9514-db26-4cf1-95f2-58b9120e4112 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:11.567677 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1e4b9514-db26-4cf1-95f2-58b9120e4112 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:11.569054 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1e4b9514-db26-4cf1-95f2-58b9120e4112 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:11.569739 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1e4b9514-db26-4cf1-95f2-58b9120e4112 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:11.601313 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-1e4b9514-db26-4cf1-95f2-58b9120e4112 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047504 May 26 16:58:11.601887 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 557/1122] 10.222.0.102 () {58 vars in 1306 bytes} [Thu May 26 16:58:11 2022] GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:58:12.613833 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-19665568-5596-4cee-af53-2d18e810a0ee tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:12.614881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-19665568-5596-4cee-af53-2d18e810a0ee tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:12.622193 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-19665568-5596-4cee-af53-2d18e810a0ee tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:12.622644 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-19665568-5596-4cee-af53-2d18e810a0ee tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:12.623410 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-19665568-5596-4cee-af53-2d18e810a0ee tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:12.623847 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-19665568-5596-4cee-af53-2d18e810a0ee tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:12.657800 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-19665568-5596-4cee-af53-2d18e810a0ee tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048660 May 26 16:58:12.658370 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 566/1123] 10.222.0.102 () {58 vars in 1306 bytes} [Thu May 26 16:58:12 2022] GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:58:13.670580 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-fe6de2f0-3e36-4f81-b152-b6df1d3447e2 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:13.671408 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-fe6de2f0-3e36-4f81-b152-b6df1d3447e2 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:13.677437 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fe6de2f0-3e36-4f81-b152-b6df1d3447e2 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:13.677880 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fe6de2f0-3e36-4f81-b152-b6df1d3447e2 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:13.678639 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fe6de2f0-3e36-4f81-b152-b6df1d3447e2 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:13.679071 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fe6de2f0-3e36-4f81-b152-b6df1d3447e2 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:13.709829 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-fe6de2f0-3e36-4f81-b152-b6df1d3447e2 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044371 May 26 16:58:13.710517 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 558/1124] 10.222.0.102 () {58 vars in 1306 bytes} [Thu May 26 16:58:13 2022] GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 16:58:13.768685 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-03aaf6da-97e6-4f28-b585-960729ef8d73 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:13.769197 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-03aaf6da-97e6-4f28-b585-960729ef8d73 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:13.775522 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-03aaf6da-97e6-4f28-b585-960729ef8d73 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:13.775969 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-03aaf6da-97e6-4f28-b585-960729ef8d73 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:13.777421 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-03aaf6da-97e6-4f28-b585-960729ef8d73 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:13.777860 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-03aaf6da-97e6-4f28-b585-960729ef8d73 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:13.803107 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-03aaf6da-97e6-4f28-b585-960729ef8d73 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3] Going to try to terminate instance {{(pid=124266) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 16:58:13.880487 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-03aaf6da-97e6-4f28-b585-960729ef8d73 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "DELETE /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3" status: 204 len: 0 microversion: 2.1 time: 0.115142 May 26 16:58:13.881138 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 567/1125] 10.222.0.102 () {58 vars in 1243 bytes} [Thu May 26 16:58:13 2022] DELETE /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 16:58:13.890062 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-ca547818-b135-4904-9c71-ae0be3cf97ce tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:13.890691 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-ca547818-b135-4904-9c71-ae0be3cf97ce tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:13.896738 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ca547818-b135-4904-9c71-ae0be3cf97ce tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:13.897173 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ca547818-b135-4904-9c71-ae0be3cf97ce tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:13.898028 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ca547818-b135-4904-9c71-ae0be3cf97ce tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:13.898463 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ca547818-b135-4904-9c71-ae0be3cf97ce tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:14.031258 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-ca547818-b135-4904-9c71-ae0be3cf97ce tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:14.038807 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-ca547818-b135-4904-9c71-ae0be3cf97ce tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3" status: 200 len: 1688 microversion: 2.1 time: 0.153148 May 26 16:58:14.039376 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 559/1126] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:58:13 2022] GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:15.056061 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-18aeaa6f-99e5-4e2a-b657-60ced68c1f27 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:15.056805 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-18aeaa6f-99e5-4e2a-b657-60ced68c1f27 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:15.063112 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-18aeaa6f-99e5-4e2a-b657-60ced68c1f27 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:15.063562 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-18aeaa6f-99e5-4e2a-b657-60ced68c1f27 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:15.064328 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-18aeaa6f-99e5-4e2a-b657-60ced68c1f27 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:15.064793 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-18aeaa6f-99e5-4e2a-b657-60ced68c1f27 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:15.238358 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-18aeaa6f-99e5-4e2a-b657-60ced68c1f27 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:15.246306 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-18aeaa6f-99e5-4e2a-b657-60ced68c1f27 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3" status: 200 len: 1688 microversion: 2.1 time: 0.194351 May 26 16:58:15.246889 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 568/1127] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:58:15 2022] GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 => generated 1688 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:15.993952 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-45405731-6363-47a6-bfbd-31a1fe66cbfc req-c442c432-7858-48ac-94df-63b7bfad8081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48502e6c-e7ed-4b82-9045-1e2c9a2be1d3", "name": "network-vif-deleted", "tag": "6668c14d-9567-4399-8261-8e6aad0fb4b4"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:58:16.003879 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-45405731-6363-47a6-bfbd-31a1fe66cbfc req-c442c432-7858-48ac-94df-63b7bfad8081 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:16.004354 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-45405731-6363-47a6-bfbd-31a1fe66cbfc req-c442c432-7858-48ac-94df-63b7bfad8081 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:16.017278 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-45405731-6363-47a6-bfbd-31a1fe66cbfc req-c442c432-7858-48ac-94df-63b7bfad8081 service nova] Creating event network-vif-deleted:6668c14d-9567-4399-8261-8e6aad0fb4b4 for instance 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 on hv-cinder-83607 May 26 16:58:16.022615 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-45405731-6363-47a6-bfbd-31a1fe66cbfc req-c442c432-7858-48ac-94df-63b7bfad8081 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033357 May 26 16:58:16.023610 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 560/1128] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:58:16.263960 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ec1ef826-f662-49d3-84a6-95e3e2c51a83 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:16.264664 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ec1ef826-f662-49d3-84a6-95e3e2c51a83 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:16.271190 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ec1ef826-f662-49d3-84a6-95e3e2c51a83 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:16.271635 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ec1ef826-f662-49d3-84a6-95e3e2c51a83 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:16.272450 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ec1ef826-f662-49d3-84a6-95e3e2c51a83 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:16.272882 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ec1ef826-f662-49d3-84a6-95e3e2c51a83 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:16.305037 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ec1ef826-f662-49d3-84a6-95e3e2c51a83 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:16.305484 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ec1ef826-f662-49d3-84a6-95e3e2c51a83 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:16.305930 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.objects.instance [None req-ec1ef826-f662-49d3-84a6-95e3e2c51a83 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lazy-loading 'fault' on Instance uuid 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 {{(pid=124266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:58:16.347593 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ec1ef826-f662-49d3-84a6-95e3e2c51a83 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:16.355476 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ec1ef826-f662-49d3-84a6-95e3e2c51a83 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3" status: 200 len: 1336 microversion: 2.1 time: 0.096123 May 26 16:58:16.356077 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 569/1129] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:58:16 2022] GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 => generated 1336 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:17.373488 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-ddb63635-6ecb-42ea-83f2-d8ff4faab7f9 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:17.374105 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-ddb63635-6ecb-42ea-83f2-d8ff4faab7f9 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:17.380441 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ddb63635-6ecb-42ea-83f2-d8ff4faab7f9 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:17.380893 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ddb63635-6ecb-42ea-83f2-d8ff4faab7f9 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:17.381659 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ddb63635-6ecb-42ea-83f2-d8ff4faab7f9 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:17.382097 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ddb63635-6ecb-42ea-83f2-d8ff4faab7f9 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:17.396870 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.wsgi [None req-ddb63635-6ecb-42ea-83f2-d8ff4faab7f9 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] HTTP exception thrown: Instance 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 could not be found. May 26 16:58:17.398473 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-ddb63635-6ecb-42ea-83f2-d8ff4faab7f9 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Request method failure captured: May 26 16:58:17.398473 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: request: GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 HTTP/1.1 May 26 16:58:17.398473 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept: application/json May 26 16:58:17.398473 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept-Encoding: identity May 26 16:58:17.398473 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Connection: close May 26 16:58:17.398473 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Length: 0 May 26 16:58:17.398473 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Type: application/json May 26 16:58:17.398473 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Host: 10.222.0.102 May 26 16:58:17.398473 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Openstack-System-Scope: None May 26 16:58:17.398473 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: User-Agent: python-urllib3/1.26.9 May 26 16:58:17.398473 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Auth-Token: gAAAAABij7BiyHwpXyrt5gouZdLSR2u247HLrYjemXZgQvKKvL_gKjh50uqCS18EIS9Fz-K4YX8tYAnNJ1wV14kiwAB02jbBtqzwSucC_mBuXxtMJigMQrPKQ8KbZZZS-Ddpdzpc4NsmLSF1WlBJg_r88uD0kjqGmk19u_c3hfGh7S_nxL5xe64 May 26 16:58:17.398473 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Id: None May 26 16:58:17.398473 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Name: None May 26 16:58:17.398473 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Identity-Status: Confirmed May 26 16:58:17.398473 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Is-Admin-Project: True May 26 16:58:17.398473 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Id: default May 26 16:58:17.398473 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Name: Default May 26 16:58:17.398473 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Id: c56b7ca2b1f54ae782302bead8a35b01 May 26 16:58:17.398473 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Name: tempest-AttachVolumeNegativeTest-482187288 May 26 16:58:17.398473 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Role: reader,member May 26 16:58:17.398473 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Roles: reader,member May 26 16:58:17.400091 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:58:17.400091 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant: tempest-AttachVolumeNegativeTest-482187288 May 26 16:58:17.400091 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Id: c56b7ca2b1f54ae782302bead8a35b01 May 26 16:58:17.400091 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-482187288 May 26 16:58:17.400091 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User: tempest-AttachVolumeNegativeTest-482187288-project May 26 16:58:17.400091 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Id: default May 26 16:58:17.400091 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Name: Default May 26 16:58:17.400091 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Id: 75cc85261ad441f8993877a959bdd97b May 26 16:58:17.400091 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Name: tempest-AttachVolumeNegativeTest-482187288-project May 26 16:58:17.400091 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: method: > May 26 16:58:17.400091 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: exception: Instance 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 could not be found. May 26 16:58:17.400091 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: action_args: {'id': '48502e6c-e7ed-4b82-9045-1e2c9a2be1d3'} May 26 16:58:17.400979 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:58:17.400979 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:58:17.400979 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:58:17.400979 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:58:17.400979 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:58:17.400979 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:58:17.400979 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:58:17.400979 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:58:17.400979 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:58:17.400979 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:58:17.400979 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 could not be found. May 26 16:58:17.400979 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:58:17.400979 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:58:17.400979 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:58:17.400979 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:58:17.400979 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:58:17.400979 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:58:17.400979 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:58:17.400979 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:58:17.400979 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:58:17.403015 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:58:17.403015 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 16:58:17.403015 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 16:58:17.403015 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:58:17.403015 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:58:17.403015 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:58:17.403015 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:58:17.403015 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 could not be found. May 26 16:58:17.403015 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:58:17.403015 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:58:17.403015 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:58:17.403015 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:58:17.403015 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:58:17.403015 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:58:17.403015 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:58:17.403015 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:58:17.403015 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 could not be found. May 26 16:58:17.403015 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 16:58:17.404509 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-ddb63635-6ecb-42ea-83f2-d8ff4faab7f9 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Returning 404 to user: Instance 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 could not be found. {{(pid=124267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:58:17.404509 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-ddb63635-6ecb-42ea-83f2-d8ff4faab7f9 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3" status: 404 len: 111 microversion: 2.1 time: 0.031275 May 26 16:58:17.404509 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 561/1130] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:58:17 2022] GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 16:58:17.409144 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-54e372ee-ebee-47c9-a0c4-2f6c93592336 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '.version_select at 0x7f93a3d4dc10>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:17.432066 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-54e372ee-ebee-47c9-a0c4-2f6c93592336 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1988310797" status: 202 len: 0 microversion: 2.1 time: 0.026577 May 26 16:58:17.432793 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 570/1131] 10.222.0.102 () {58 vars in 1225 bytes} [Thu May 26 16:58:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1988310797 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 16:58:18.037386 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-2bb8dc1d-1023-45b2-a4f5-57a34e56c7a4 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Action: 'create', calling method: .version_select at 0x7f93a3d945e0>, body: {"keypair": {"name": "tempest-keypair-134695234", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC441QK36/O9SI4WCADvRnzOk7ve+if8VMMEFer3XJtgwr2svHmKgB3c9W6YCrhk8ZDld1A8b2MHGSRT0W6p0ZaEjynwzsnvrNQ3al3zj6/juCAmpk5mfVA0FQlgANEzyg=="}} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:58:18.052136 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.quota [None req-2bb8dc1d-1023-45b2-a4f5-57a34e56c7a4 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Getting quotas for project c56b7ca2b1f54ae782302bead8a35b01. Resources: {'key_pairs'} {{(pid=124267) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:58:18.056049 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.quota [None req-2bb8dc1d-1023-45b2-a4f5-57a34e56c7a4 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Getting quotas for user 75cc85261ad441f8993877a959bdd97b and project c56b7ca2b1f54ae782302bead8a35b01. Resources: {'key_pairs'} {{(pid=124267) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:58:18.078003 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-2bb8dc1d-1023-45b2-a4f5-57a34e56c7a4 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044528 May 26 16:58:18.078598 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 562/1132] 10.222.0.102 () {60 vars in 1163 bytes} [Thu May 26 16:58:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:58:19.313331 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9415acf7-b853-460a-be69-a2b46a5dc27d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1748861497", "imageRef": "d74c4a51-21fe-41d5-865a-cb93604ac3aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1ef1a782-8a32-40c0-8c50-f68f3f393fb7"}], "security_groups": [{"name": "tempest-securitygroup--2068495269"}], "key_name": "tempest-keypair-134695234", "user_data": "}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:58:19.416823 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.network.neutron [None req-9415acf7-b853-460a-be69-a2b46a5dc27d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] validate_networks() for [('1ef1a782-8a32-40c0-8c50-f68f3f393fb7', None, None, None, None, None)] {{(pid=124266) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:58:19.834866 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-9415acf7-b853-460a-be69-a2b46a5dc27d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Flavor limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:58:19.835334 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-9415acf7-b853-460a-be69-a2b46a5dc27d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Image limits 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:58:19.835815 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-9415acf7-b853-460a-be69-a2b46a5dc27d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Flavor pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:58:19.836231 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-9415acf7-b853-460a-be69-a2b46a5dc27d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Image pref 0:0:0 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:58:19.836682 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.virt.hardware [None req-9415acf7-b853-460a-be69-a2b46a5dc27d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:58:19.846251 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9415acf7-b853-460a-be69-a2b46a5dc27d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:19.846706 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9415acf7-b853-460a-be69-a2b46a5dc27d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:19.847518 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9415acf7-b853-460a-be69-a2b46a5dc27d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:19.847959 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9415acf7-b853-460a-be69-a2b46a5dc27d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:19.866055 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-9415acf7-b853-460a-be69-a2b46a5dc27d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Getting quotas for project c56b7ca2b1f54ae782302bead8a35b01. Resources: {'cores', 'instances', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:58:19.869955 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-9415acf7-b853-460a-be69-a2b46a5dc27d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Getting quotas for user 75cc85261ad441f8993877a959bdd97b and project c56b7ca2b1f54ae782302bead8a35b01. Resources: {'cores', 'instances', 'ram'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:58:19.880930 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9415acf7-b853-460a-be69-a2b46a5dc27d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Going to run 1 instances... {{(pid=124266) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:58:19.883207 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9415acf7-b853-460a-be69-a2b46a5dc27d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d74c4a51-21fe-41d5-865a-cb93604ac3aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:58:19.931535 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9415acf7-b853-460a-be69-a2b46a5dc27d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.624369 May 26 16:58:19.932193 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 571/1133] 10.222.0.102 () {60 vars in 1151 bytes} [Thu May 26 16:58:19 2022] POST /compute/v2.1/servers => generated 404 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 16:58:19.943043 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-4229fffb-031d-4887-8522-3422d3d92da2 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:19.943655 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-4229fffb-031d-4887-8522-3422d3d92da2 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:19.998310 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-4229fffb-031d-4887-8522-3422d3d92da2 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:20.005886 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-4229fffb-031d-4887-8522-3422d3d92da2 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3" status: 200 len: 1245 microversion: 2.1 time: 0.067221 May 26 16:58:20.006452 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 563/1134] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:58:19 2022] GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 => generated 1245 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:21.024291 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-01113bb6-193a-4596-b814-ea190201c7b1 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:21.024942 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-01113bb6-193a-4596-b814-ea190201c7b1 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:21.031489 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-01113bb6-193a-4596-b814-ea190201c7b1 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:21.031934 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-01113bb6-193a-4596-b814-ea190201c7b1 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:21.032724 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-01113bb6-193a-4596-b814-ea190201c7b1 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:21.033158 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-01113bb6-193a-4596-b814-ea190201c7b1 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:21.113007 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-01113bb6-193a-4596-b814-ea190201c7b1 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:21.120831 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-01113bb6-193a-4596-b814-ea190201c7b1 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3" status: 200 len: 1303 microversion: 2.1 time: 0.100793 May 26 16:58:21.121444 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 572/1135] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:58:21 2022] GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:22.139001 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-d8e3ff00-16ec-4093-9c66-131406791270 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:22.139794 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-d8e3ff00-16ec-4093-9c66-131406791270 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:22.147075 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d8e3ff00-16ec-4093-9c66-131406791270 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:22.147528 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d8e3ff00-16ec-4093-9c66-131406791270 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:22.148520 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d8e3ff00-16ec-4093-9c66-131406791270 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:22.148956 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d8e3ff00-16ec-4093-9c66-131406791270 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:22.377165 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-d8e3ff00-16ec-4093-9c66-131406791270 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:22.384792 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-d8e3ff00-16ec-4093-9c66-131406791270 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3" status: 200 len: 1371 microversion: 2.1 time: 0.250514 May 26 16:58:22.385372 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 564/1136] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:58:22 2022] GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 => generated 1371 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:22.740141 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-72c22be0-2461-4d19-870b-c64851030655 req-147c9208-f3a6-4759-961d-aa433b2e7f31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09cc4140-fc5a-40fb-a615-76e1a4e9f7d3", "tag": "19061fb6-33c6-46e8-b9a1-9f5ce66988f7"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:58:22.758209 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-72c22be0-2461-4d19-870b-c64851030655 req-147c9208-f3a6-4759-961d-aa433b2e7f31 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:22.758610 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-72c22be0-2461-4d19-870b-c64851030655 req-147c9208-f3a6-4759-961d-aa433b2e7f31 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:22.774264 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-72c22be0-2461-4d19-870b-c64851030655 req-147c9208-f3a6-4759-961d-aa433b2e7f31 service nova] Creating event network-changed:19061fb6-33c6-46e8-b9a1-9f5ce66988f7 for instance 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 on hv-cinder-83607 May 26 16:58:22.780391 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-72c22be0-2461-4d19-870b-c64851030655 req-147c9208-f3a6-4759-961d-aa433b2e7f31 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053228 May 26 16:58:22.781867 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 573/1137] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:58:23.402459 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-2016d1c7-ff38-4dee-8d76-28d033fa4a25 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:23.403012 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-2016d1c7-ff38-4dee-8d76-28d033fa4a25 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:23.409508 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2016d1c7-ff38-4dee-8d76-28d033fa4a25 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:23.409956 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2016d1c7-ff38-4dee-8d76-28d033fa4a25 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:23.410725 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2016d1c7-ff38-4dee-8d76-28d033fa4a25 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:23.411170 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2016d1c7-ff38-4dee-8d76-28d033fa4a25 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:23.541826 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-2016d1c7-ff38-4dee-8d76-28d033fa4a25 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:23.549872 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-2016d1c7-ff38-4dee-8d76-28d033fa4a25 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3" status: 200 len: 1371 microversion: 2.1 time: 0.151420 May 26 16:58:23.550431 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 565/1138] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:58:23 2022] GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:24.568143 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-5f92d0b3-54c5-46df-b5ad-0daf181151ec tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:24.568815 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-5f92d0b3-54c5-46df-b5ad-0daf181151ec tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:24.576062 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5f92d0b3-54c5-46df-b5ad-0daf181151ec tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:24.576554 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5f92d0b3-54c5-46df-b5ad-0daf181151ec tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:24.577332 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5f92d0b3-54c5-46df-b5ad-0daf181151ec tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:24.577770 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-5f92d0b3-54c5-46df-b5ad-0daf181151ec tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:24.713637 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-5f92d0b3-54c5-46df-b5ad-0daf181151ec tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:24.721205 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-5f92d0b3-54c5-46df-b5ad-0daf181151ec tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3" status: 200 len: 1371 microversion: 2.1 time: 0.157352 May 26 16:58:24.721767 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 574/1139] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:58:24 2022] GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:25.738353 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-5259d120-b0e2-429c-869a-06848bdf563e tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:25.738903 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-5259d120-b0e2-429c-869a-06848bdf563e tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:25.745478 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-5259d120-b0e2-429c-869a-06848bdf563e tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:25.745923 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-5259d120-b0e2-429c-869a-06848bdf563e tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:25.746682 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-5259d120-b0e2-429c-869a-06848bdf563e tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:25.747115 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-5259d120-b0e2-429c-869a-06848bdf563e tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:25.874029 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-5259d120-b0e2-429c-869a-06848bdf563e tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:25.881518 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-5259d120-b0e2-429c-869a-06848bdf563e tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3" status: 200 len: 1371 microversion: 2.1 time: 0.147145 May 26 16:58:25.882083 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 566/1140] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:58:25 2022] GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 => generated 1371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:26.898939 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7f9b8b3d-bccb-40dc-a1c7-fe6cee3bdc8d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:26.899474 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-7f9b8b3d-bccb-40dc-a1c7-fe6cee3bdc8d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:26.905906 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7f9b8b3d-bccb-40dc-a1c7-fe6cee3bdc8d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:26.906350 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7f9b8b3d-bccb-40dc-a1c7-fe6cee3bdc8d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:26.907104 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7f9b8b3d-bccb-40dc-a1c7-fe6cee3bdc8d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:26.907536 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7f9b8b3d-bccb-40dc-a1c7-fe6cee3bdc8d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:27.037806 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-7f9b8b3d-bccb-40dc-a1c7-fe6cee3bdc8d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:27.045317 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7f9b8b3d-bccb-40dc-a1c7-fe6cee3bdc8d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3" status: 200 len: 1371 microversion: 2.1 time: 0.150365 May 26 16:58:27.045882 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 575/1141] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:58:26 2022] GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:28.062150 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-75d7599e-2b3a-4c39-9343-fd9b576ec799 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:28.062758 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-75d7599e-2b3a-4c39-9343-fd9b576ec799 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:28.069402 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-75d7599e-2b3a-4c39-9343-fd9b576ec799 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:28.069855 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-75d7599e-2b3a-4c39-9343-fd9b576ec799 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:28.070614 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-75d7599e-2b3a-4c39-9343-fd9b576ec799 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:28.071118 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-75d7599e-2b3a-4c39-9343-fd9b576ec799 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:28.206963 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-75d7599e-2b3a-4c39-9343-fd9b576ec799 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:28.215044 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-75d7599e-2b3a-4c39-9343-fd9b576ec799 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3" status: 200 len: 1371 microversion: 2.1 time: 0.156996 May 26 16:58:28.216261 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 567/1142] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:58:28 2022] GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:29.233373 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0506464c-cfe8-49a9-9f64-48609bf4f7c3 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:29.233963 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0506464c-cfe8-49a9-9f64-48609bf4f7c3 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:29.240448 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0506464c-cfe8-49a9-9f64-48609bf4f7c3 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:29.240902 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0506464c-cfe8-49a9-9f64-48609bf4f7c3 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:29.241662 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0506464c-cfe8-49a9-9f64-48609bf4f7c3 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:29.242122 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0506464c-cfe8-49a9-9f64-48609bf4f7c3 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:29.246069 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:29.374236 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0506464c-cfe8-49a9-9f64-48609bf4f7c3 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:29.381829 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0506464c-cfe8-49a9-9f64-48609bf4f7c3 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3" status: 200 len: 1371 microversion: 2.1 time: 0.153195 May 26 16:58:29.382405 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 576/1143] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:58:29 2022] GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:30.281728 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-675eb49c-5ac6-4220-9f55-4b81045be4c3 req-f2a9440c-a79e-4c0b-9ab8-d0b099881136 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09cc4140-fc5a-40fb-a615-76e1a4e9f7d3", "name": "network-vif-plugged", "status": "completed", "tag": "19061fb6-33c6-46e8-b9a1-9f5ce66988f7"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:58:30.286949 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell0:SELECT=6 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:30.291618 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-675eb49c-5ac6-4220-9f55-4b81045be4c3 req-f2a9440c-a79e-4c0b-9ab8-d0b099881136 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:30.292070 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-675eb49c-5ac6-4220-9f55-4b81045be4c3 req-f2a9440c-a79e-4c0b-9ab8-d0b099881136 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:30.304507 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-675eb49c-5ac6-4220-9f55-4b81045be4c3 req-f2a9440c-a79e-4c0b-9ab8-d0b099881136 service nova] Creating event network-vif-plugged:19061fb6-33c6-46e8-b9a1-9f5ce66988f7 for instance 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 on hv-cinder-83607 May 26 16:58:30.311679 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-675eb49c-5ac6-4220-9f55-4b81045be4c3 req-f2a9440c-a79e-4c0b-9ab8-d0b099881136 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032596 May 26 16:58:30.312738 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 568/1144] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:58:30.398712 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-de6bc0a4-1022-47c1-aece-985b39524520 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:30.399345 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-de6bc0a4-1022-47c1-aece-985b39524520 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:30.401233 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=2 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:30.401895 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=6 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:30.410351 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-de6bc0a4-1022-47c1-aece-985b39524520 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:30.410809 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-de6bc0a4-1022-47c1-aece-985b39524520 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:30.411594 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-de6bc0a4-1022-47c1-aece-985b39524520 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:30.412039 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-de6bc0a4-1022-47c1-aece-985b39524520 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:30.578379 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-de6bc0a4-1022-47c1-aece-985b39524520 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:30.586090 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-de6bc0a4-1022-47c1-aece-985b39524520 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3" status: 200 len: 1371 microversion: 2.1 time: 0.191295 May 26 16:58:30.586660 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 577/1145] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:58:30 2022] GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 => generated 1371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:31.605285 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-59b8b8a3-3c1c-4438-affe-fc72dd0346b4 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:31.605903 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-59b8b8a3-3c1c-4438-affe-fc72dd0346b4 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:31.612199 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-59b8b8a3-3c1c-4438-affe-fc72dd0346b4 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:31.612686 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-59b8b8a3-3c1c-4438-affe-fc72dd0346b4 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:31.613456 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-59b8b8a3-3c1c-4438-affe-fc72dd0346b4 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:31.613901 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-59b8b8a3-3c1c-4438-affe-fc72dd0346b4 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:31.744991 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-59b8b8a3-3c1c-4438-affe-fc72dd0346b4 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:31.754160 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-59b8b8a3-3c1c-4438-affe-fc72dd0346b4 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3" status: 200 len: 1371 microversion: 2.1 time: 0.153663 May 26 16:58:31.754728 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 569/1146] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:58:31 2022] GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:32.771408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9f01bfbe-e9d4-4ba4-b5c7-262d82424a88 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:32.772126 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9f01bfbe-e9d4-4ba4-b5c7-262d82424a88 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:32.778760 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9f01bfbe-e9d4-4ba4-b5c7-262d82424a88 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:32.779201 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9f01bfbe-e9d4-4ba4-b5c7-262d82424a88 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:32.780645 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9f01bfbe-e9d4-4ba4-b5c7-262d82424a88 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:32.781079 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9f01bfbe-e9d4-4ba4-b5c7-262d82424a88 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:32.915964 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-9f01bfbe-e9d4-4ba4-b5c7-262d82424a88 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:32.924325 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9f01bfbe-e9d4-4ba4-b5c7-262d82424a88 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3" status: 200 len: 1371 microversion: 2.1 time: 0.156014 May 26 16:58:32.924325 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 578/1147] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:58:32 2022] GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:33.940978 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-9a8c5928-0590-4653-8695-889322fa7727 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:33.941576 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-9a8c5928-0590-4653-8695-889322fa7727 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:33.947968 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9a8c5928-0590-4653-8695-889322fa7727 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:33.948434 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9a8c5928-0590-4653-8695-889322fa7727 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:33.949196 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9a8c5928-0590-4653-8695-889322fa7727 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:33.949715 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9a8c5928-0590-4653-8695-889322fa7727 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:34.085783 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-9a8c5928-0590-4653-8695-889322fa7727 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:34.093263 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-9a8c5928-0590-4653-8695-889322fa7727 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3" status: 200 len: 1562 microversion: 2.1 time: 0.156562 May 26 16:58:34.094458 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 570/1148] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:58:33 2022] GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:34.110058 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a4c1b2dd-572b-4d62-a364-bfdcde397be4 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:34.110597 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a4c1b2dd-572b-4d62-a364-bfdcde397be4 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:34.117012 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a4c1b2dd-572b-4d62-a364-bfdcde397be4 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:34.117457 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a4c1b2dd-572b-4d62-a364-bfdcde397be4 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:34.118210 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a4c1b2dd-572b-4d62-a364-bfdcde397be4 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:34.118647 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a4c1b2dd-572b-4d62-a364-bfdcde397be4 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:34.195031 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a4c1b2dd-572b-4d62-a364-bfdcde397be4 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088706 May 26 16:58:34.195630 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 579/1149] 10.222.0.102 () {58 vars in 1279 bytes} [Thu May 26 16:58:34 2022] GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:58:35.119921 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-1827e711-27b2-495c-a25c-c243b56e7219 req-45d6da0c-07ba-4907-996e-99f63b3b282c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09cc4140-fc5a-40fb-a615-76e1a4e9f7d3", "tag": "19061fb6-33c6-46e8-b9a1-9f5ce66988f7"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:58:35.128531 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-1827e711-27b2-495c-a25c-c243b56e7219 req-45d6da0c-07ba-4907-996e-99f63b3b282c service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:35.128974 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-1827e711-27b2-495c-a25c-c243b56e7219 req-45d6da0c-07ba-4907-996e-99f63b3b282c service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:35.140238 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-1827e711-27b2-495c-a25c-c243b56e7219 req-45d6da0c-07ba-4907-996e-99f63b3b282c service nova] Creating event network-changed:19061fb6-33c6-46e8-b9a1-9f5ce66988f7 for instance 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 on hv-cinder-83607 May 26 16:58:35.145529 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-1827e711-27b2-495c-a25c-c243b56e7219 req-45d6da0c-07ba-4907-996e-99f63b3b282c service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029170 May 26 16:58:35.146163 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 571/1150] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:59:53.337390 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:53.338537 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=20 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:53.340554 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:53.341786 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=88 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:53.344159 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-2ef2c885-ef1c-48ec-a27d-c4803b052ca8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:53.345030 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2ef2c885-ef1c-48ec-a27d-c4803b052ca8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: bf9c9c4c-8480-4bcd-bebb-755535668e7b] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:53.354875 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2ef2c885-ef1c-48ec-a27d-c4803b052ca8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:53.355340 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2ef2c885-ef1c-48ec-a27d-c4803b052ca8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:53.356161 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2ef2c885-ef1c-48ec-a27d-c4803b052ca8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:53.356763 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-2ef2c885-ef1c-48ec-a27d-c4803b052ca8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:53.388050 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-2ef2c885-ef1c-48ec-a27d-c4803b052ca8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: bf9c9c4c-8480-4bcd-bebb-755535668e7b] Going to try to terminate instance {{(pid=124266) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 16:59:53.412733 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-6ed3d674-2806-41e0-841d-251ee6df18ff req-39218635-ce9d-4dca-8a2f-78660bb9a1eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf9c9c4c-8480-4bcd-bebb-755535668e7b", "tag": "f5293931-bd02-4f73-80b1-b2d73ca2f6c3"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:59:53.421233 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-6ed3d674-2806-41e0-841d-251ee6df18ff req-39218635-ce9d-4dca-8a2f-78660bb9a1eb service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:53.421671 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-6ed3d674-2806-41e0-841d-251ee6df18ff req-39218635-ce9d-4dca-8a2f-78660bb9a1eb service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:53.434156 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-6ed3d674-2806-41e0-841d-251ee6df18ff req-39218635-ce9d-4dca-8a2f-78660bb9a1eb service nova] Creating event network-changed:f5293931-bd02-4f73-80b1-b2d73ca2f6c3 for instance bf9c9c4c-8480-4bcd-bebb-755535668e7b on hv-cinder-83607 May 26 16:59:53.438966 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-6ed3d674-2806-41e0-841d-251ee6df18ff req-39218635-ce9d-4dca-8a2f-78660bb9a1eb service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101426 May 26 16:59:53.440167 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 572/1151] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:59:53.472503 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-2ef2c885-ef1c-48ec-a27d-c4803b052ca8 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "DELETE /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b" status: 204 len: 0 microversion: 2.1 time: 0.138061 May 26 16:59:53.473100 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 580/1152] 10.222.0.102 () {58 vars in 1243 bytes} [Thu May 26 16:59:53 2022] DELETE /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 16:59:53.488495 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-a0ced3e1-6f2c-45ba-929f-b57182a94f2c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:53.492026 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-a0ced3e1-6f2c-45ba-929f-b57182a94f2c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: bf9c9c4c-8480-4bcd-bebb-755535668e7b] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:53.502753 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a0ced3e1-6f2c-45ba-929f-b57182a94f2c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:53.503813 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a0ced3e1-6f2c-45ba-929f-b57182a94f2c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:53.504904 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a0ced3e1-6f2c-45ba-929f-b57182a94f2c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:53.506507 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-a0ced3e1-6f2c-45ba-929f-b57182a94f2c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:53.651514 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-a0ced3e1-6f2c-45ba-929f-b57182a94f2c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:53.659330 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-a0ced3e1-6f2c-45ba-929f-b57182a94f2c tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b" status: 200 len: 1580 microversion: 2.1 time: 0.175365 May 26 16:59:53.659912 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 573/1153] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:59:53 2022] GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b => generated 1580 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:54.678459 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-72ee55f1-1754-4f4d-9c88-67dd382a7494 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:54.679081 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-72ee55f1-1754-4f4d-9c88-67dd382a7494 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: bf9c9c4c-8480-4bcd-bebb-755535668e7b] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:54.685985 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-72ee55f1-1754-4f4d-9c88-67dd382a7494 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:54.686440 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-72ee55f1-1754-4f4d-9c88-67dd382a7494 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:54.687212 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-72ee55f1-1754-4f4d-9c88-67dd382a7494 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:54.687650 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-72ee55f1-1754-4f4d-9c88-67dd382a7494 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:54.904316 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-72ee55f1-1754-4f4d-9c88-67dd382a7494 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:54.912055 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-72ee55f1-1754-4f4d-9c88-67dd382a7494 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b" status: 200 len: 1580 microversion: 2.1 time: 0.237839 May 26 16:59:54.912681 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 581/1154] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:59:54 2022] GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b => generated 1580 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:59:55.929952 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-c0450dd6-9aec-4596-a876-c582b9d55399 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:55.930558 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-c0450dd6-9aec-4596-a876-c582b9d55399 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: bf9c9c4c-8480-4bcd-bebb-755535668e7b] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:55.937268 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c0450dd6-9aec-4596-a876-c582b9d55399 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:55.937712 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c0450dd6-9aec-4596-a876-c582b9d55399 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:55.938493 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c0450dd6-9aec-4596-a876-c582b9d55399 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:55.938955 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-c0450dd6-9aec-4596-a876-c582b9d55399 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:56.419523 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-c0450dd6-9aec-4596-a876-c582b9d55399 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:56.427473 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-c0450dd6-9aec-4596-a876-c582b9d55399 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b" status: 200 len: 1461 microversion: 2.1 time: 0.502012 May 26 16:59:56.428100 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 574/1155] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:59:55 2022] GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b => generated 1461 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:56.739714 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-a392122f-09f4-417a-9305-15bb325ca3e9 req-e216398e-6bea-4ea6-a1ae-3be10fd38c95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf9c9c4c-8480-4bcd-bebb-755535668e7b", "name": "network-vif-deleted", "tag": "f5293931-bd02-4f73-80b1-b2d73ca2f6c3"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:59:56.748780 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-a392122f-09f4-417a-9305-15bb325ca3e9 req-e216398e-6bea-4ea6-a1ae-3be10fd38c95 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:56.749231 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-a392122f-09f4-417a-9305-15bb325ca3e9 req-e216398e-6bea-4ea6-a1ae-3be10fd38c95 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:56.760760 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-a392122f-09f4-417a-9305-15bb325ca3e9 req-e216398e-6bea-4ea6-a1ae-3be10fd38c95 service nova] Creating event network-vif-deleted:f5293931-bd02-4f73-80b1-b2d73ca2f6c3 for instance bf9c9c4c-8480-4bcd-bebb-755535668e7b on hv-cinder-83607 May 26 16:59:56.765445 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-a392122f-09f4-417a-9305-15bb325ca3e9 req-e216398e-6bea-4ea6-a1ae-3be10fd38c95 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090402 May 26 16:59:56.766037 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 582/1156] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 16:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:59:57.444167 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-36dc241f-65b4-4cbc-8365-42913b4639e0 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:57.445435 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-36dc241f-65b4-4cbc-8365-42913b4639e0 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: bf9c9c4c-8480-4bcd-bebb-755535668e7b] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:57.453236 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-36dc241f-65b4-4cbc-8365-42913b4639e0 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:57.453890 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-36dc241f-65b4-4cbc-8365-42913b4639e0 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:57.454778 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-36dc241f-65b4-4cbc-8365-42913b4639e0 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:57.455224 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-36dc241f-65b4-4cbc-8365-42913b4639e0 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:57.487966 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-36dc241f-65b4-4cbc-8365-42913b4639e0 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:57.488453 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-36dc241f-65b4-4cbc-8365-42913b4639e0 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:57.488908 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.objects.instance [None req-36dc241f-65b4-4cbc-8365-42913b4639e0 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lazy-loading 'fault' on Instance uuid bf9c9c4c-8480-4bcd-bebb-755535668e7b {{(pid=124267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:59:57.529836 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-36dc241f-65b4-4cbc-8365-42913b4639e0 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:57.538303 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-36dc241f-65b4-4cbc-8365-42913b4639e0 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b" status: 200 len: 1233 microversion: 2.1 time: 0.097728 May 26 16:59:57.538877 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 575/1157] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:59:57 2022] GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b => generated 1233 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:58.556906 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8363c6ac-6154-41e6-92a8-dc3d1f268e56 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:58.557610 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-8363c6ac-6154-41e6-92a8-dc3d1f268e56 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: bf9c9c4c-8480-4bcd-bebb-755535668e7b] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:58.563951 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8363c6ac-6154-41e6-92a8-dc3d1f268e56 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:58.564344 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8363c6ac-6154-41e6-92a8-dc3d1f268e56 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:58.565463 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8363c6ac-6154-41e6-92a8-dc3d1f268e56 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:58.565902 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-8363c6ac-6154-41e6-92a8-dc3d1f268e56 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:58.579315 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-8363c6ac-6154-41e6-92a8-dc3d1f268e56 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] HTTP exception thrown: Instance bf9c9c4c-8480-4bcd-bebb-755535668e7b could not be found. May 26 16:59:58.580961 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8363c6ac-6154-41e6-92a8-dc3d1f268e56 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Request method failure captured: May 26 16:59:58.580961 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b HTTP/1.1 May 26 16:59:58.580961 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept: application/json May 26 16:59:58.580961 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity May 26 16:59:58.580961 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Connection: close May 26 16:59:58.580961 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Length: 0 May 26 16:59:58.580961 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Type: application/json May 26 16:59:58.580961 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Host: 10.222.0.102 May 26 16:59:58.580961 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None May 26 16:59:58.580961 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 May 26 16:59:58.580961 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABij6-bCnz1krl3jvaMy3xBF_gVub4hyPORFSK_UZUqjMUnGopA_9vnLUGx7868E9wmXQ1i5XTbb8Ln3FLxLb13_-qyF56oOXfxAmPwNOJGO8o7u7A9EhqvrJzh-ml-alqWaq98EV8cXVkUt9_F5g-U7YzkZgUh57FsEKUyPEyHuepAcPU May 26 16:59:58.580961 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Id: None May 26 16:59:58.580961 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Name: None May 26 16:59:58.580961 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed May 26 16:59:58.580961 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True May 26 16:59:58.580961 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default May 26 16:59:58.580961 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default May 26 16:59:58.580961 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Id: 257f08cba99b478db51729bf108ec901 May 26 16:59:58.580961 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-TestVolumeBootPattern-2097601180 May 26 16:59:58.580961 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Role: reader,member May 26 16:59:58.580961 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Roles: reader,member May 26 16:59:58.582720 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/257f08cba99b478db51729bf108ec901"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/257f08cba99b478db51729bf108ec901"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/257f08cba99b478db51729bf108ec901"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_257f08cba99b478db51729bf108ec901"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 16:59:58.582720 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-TestVolumeBootPattern-2097601180 May 26 16:59:58.582720 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Id: 257f08cba99b478db51729bf108ec901 May 26 16:59:58.582720 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-TestVolumeBootPattern-2097601180 May 26 16:59:58.582720 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User: tempest-TestVolumeBootPattern-2097601180-project May 26 16:59:58.582720 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default May 26 16:59:58.582720 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default May 26 16:59:58.582720 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Id: 6f7a1fe832af4c83b4b969729d0721e9 May 26 16:59:58.582720 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-TestVolumeBootPattern-2097601180-project May 26 16:59:58.582720 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: method: > May 26 16:59:58.582720 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: exception: Instance bf9c9c4c-8480-4bcd-bebb-755535668e7b could not be found. May 26 16:59:58.582720 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: action_args: {'id': 'bf9c9c4c-8480-4bcd-bebb-755535668e7b'} May 26 16:59:58.583711 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:59:58.583711 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:59:58.583711 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:59:58.583711 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:59:58.583711 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:59:58.583711 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:59:58.583711 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:59:58.583711 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:59:58.583711 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:59:58.583711 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:59:58.583711 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf9c9c4c-8480-4bcd-bebb-755535668e7b could not be found. May 26 16:59:58.583711 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:59:58.583711 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:59:58.583711 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:59:58.583711 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:59:58.583711 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:59:58.583711 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:59:58.583711 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:59:58.583711 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:59:58.583711 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:59:58.585368 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:59:58.585368 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 16:59:58.585368 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 16:59:58.585368 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:59:58.585368 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:59:58.585368 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:59:58.585368 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:59:58.585368 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf9c9c4c-8480-4bcd-bebb-755535668e7b could not be found. May 26 16:59:58.585368 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:59:58.585368 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:59:58.585368 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:59:58.585368 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:59:58.585368 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:59:58.585368 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:59:58.585368 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:59:58.585368 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:59:58.585368 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf9c9c4c-8480-4bcd-bebb-755535668e7b could not be found. May 26 16:59:58.585368 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 16:59:58.586912 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-8363c6ac-6154-41e6-92a8-dc3d1f268e56 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Returning 404 to user: Instance bf9c9c4c-8480-4bcd-bebb-755535668e7b could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:59:58.586912 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-8363c6ac-6154-41e6-92a8-dc3d1f268e56 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b" status: 404 len: 111 microversion: 2.1 time: 0.030857 May 26 16:59:58.586912 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 583/1158] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 16:59:58 2022] GET /compute/v2.1/servers/bf9c9c4c-8480-4bcd-bebb-755535668e7b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:00:01.643099 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-1e73b503-29d6-4b15-9f06-21f0ffcef498 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:01.643687 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-1e73b503-29d6-4b15-9f06-21f0ffcef498 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 67dbd32c-21f9-48b2-b4b2-74f37cce2d82] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:01.645543 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-b5a53ec4-5f15-42f5-a58b-7ff05c9e6911 req-60ac2795-eb44-43c3-b4cd-5713404da1d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67dbd32c-21f9-48b2-b4b2-74f37cce2d82", "tag": "8b3af3df-2524-4785-8ea4-ef0b84e6d32e"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:00:01.654938 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1e73b503-29d6-4b15-9f06-21f0ffcef498 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:01.654938 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1e73b503-29d6-4b15-9f06-21f0ffcef498 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:01.654938 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1e73b503-29d6-4b15-9f06-21f0ffcef498 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:01.654938 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-1e73b503-29d6-4b15-9f06-21f0ffcef498 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:01.655427 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-b5a53ec4-5f15-42f5-a58b-7ff05c9e6911 req-60ac2795-eb44-43c3-b4cd-5713404da1d9 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:01.657072 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-b5a53ec4-5f15-42f5-a58b-7ff05c9e6911 req-60ac2795-eb44-43c3-b4cd-5713404da1d9 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:01.671953 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-b5a53ec4-5f15-42f5-a58b-7ff05c9e6911 req-60ac2795-eb44-43c3-b4cd-5713404da1d9 service nova] Creating event network-changed:8b3af3df-2524-4785-8ea4-ef0b84e6d32e for instance 67dbd32c-21f9-48b2-b4b2-74f37cce2d82 on hv-cinder-83607 May 26 17:00:01.679053 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-b5a53ec4-5f15-42f5-a58b-7ff05c9e6911 req-60ac2795-eb44-43c3-b4cd-5713404da1d9 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036498 May 26 17:00:01.683463 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 584/1159] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 17:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:00:01.694667 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-1e73b503-29d6-4b15-9f06-21f0ffcef498 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 67dbd32c-21f9-48b2-b4b2-74f37cce2d82] Going to try to terminate instance {{(pid=124267) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 17:00:01.787984 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-1e73b503-29d6-4b15-9f06-21f0ffcef498 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "DELETE /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82" status: 204 len: 0 microversion: 2.1 time: 0.148217 May 26 17:00:01.788619 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 576/1160] 10.222.0.102 () {58 vars in 1243 bytes} [Thu May 26 17:00:01 2022] DELETE /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 17:00:01.799599 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-161b3faa-5c6a-486c-947d-8e62d2817651 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:01.801672 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-161b3faa-5c6a-486c-947d-8e62d2817651 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 67dbd32c-21f9-48b2-b4b2-74f37cce2d82] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:01.809161 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-161b3faa-5c6a-486c-947d-8e62d2817651 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:01.809854 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-161b3faa-5c6a-486c-947d-8e62d2817651 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:01.811091 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-161b3faa-5c6a-486c-947d-8e62d2817651 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:01.811814 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-161b3faa-5c6a-486c-947d-8e62d2817651 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:01.880924 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-6f681243-768d-4be6-8388-06b49b8c6418 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:01.881461 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-6f681243-768d-4be6-8388-06b49b8c6418 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:01.887546 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-6f681243-768d-4be6-8388-06b49b8c6418 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:01.887994 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-6f681243-768d-4be6-8388-06b49b8c6418 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:01.888922 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-6f681243-768d-4be6-8388-06b49b8c6418 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:01.889357 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-6f681243-768d-4be6-8388-06b49b8c6418 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:01.914470 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-6f681243-768d-4be6-8388-06b49b8c6418 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3/ips" status: 200 len: 150 microversion: 2.1 time: 0.037825 May 26 17:00:01.915231 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 577/1161] 10.222.0.102 () {58 vars in 1252 bytes} [Thu May 26 17:00:01 2022] GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:00:01.987315 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-161b3faa-5c6a-486c-947d-8e62d2817651 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:01.999375 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-161b3faa-5c6a-486c-947d-8e62d2817651 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82" status: 200 len: 1578 microversion: 2.1 time: 0.204332 May 26 17:00:02.001688 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 585/1162] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 17:00:01 2022] GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82 => generated 1578 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:03.018186 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-20e27277-73ff-49af-86aa-2f855f263620 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:03.018796 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-20e27277-73ff-49af-86aa-2f855f263620 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 67dbd32c-21f9-48b2-b4b2-74f37cce2d82] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:03.025761 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-20e27277-73ff-49af-86aa-2f855f263620 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:03.026219 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-20e27277-73ff-49af-86aa-2f855f263620 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:03.027082 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-20e27277-73ff-49af-86aa-2f855f263620 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:03.027525 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-20e27277-73ff-49af-86aa-2f855f263620 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:03.234999 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-20e27277-73ff-49af-86aa-2f855f263620 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:03.243525 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-20e27277-73ff-49af-86aa-2f855f263620 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82" status: 200 len: 1460 microversion: 2.1 time: 0.229271 May 26 17:00:03.249380 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 578/1163] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 17:00:03 2022] GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82 => generated 1460 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:03.280877 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-9331cf4e-a7b3-4b35-a922-4eb4bcfc5477 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9143b69-365e-4fb0-a97d-b2a3e3b9243d"}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:00:03.281855 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-9331cf4e-a7b3-4b35-a922-4eb4bcfc5477 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:03.288425 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9331cf4e-a7b3-4b35-a922-4eb4bcfc5477 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:03.288881 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9331cf4e-a7b3-4b35-a922-4eb4bcfc5477 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:03.289649 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9331cf4e-a7b3-4b35-a922-4eb4bcfc5477 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:03.290083 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-9331cf4e-a7b3-4b35-a922-4eb4bcfc5477 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:03.601766 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-9331cf4e-a7b3-4b35-a922-4eb4bcfc5477 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "POST /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.325196 May 26 17:00:03.602395 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 586/1164] 10.222.0.102 () {60 vars in 1327 bytes} [Thu May 26 17:00:03 2022] POST /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3/os-volume_attachments => generated 194 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:00:03.694513 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-ee6af559-d14c-4bbc-ac55-0757505956b3 req-0cd195d8-00eb-4a6c-9b0f-bd55db203d16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67dbd32c-21f9-48b2-b4b2-74f37cce2d82", "name": "network-vif-deleted", "tag": "8b3af3df-2524-4785-8ea4-ef0b84e6d32e"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:00:03.703203 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-ee6af559-d14c-4bbc-ac55-0757505956b3 req-0cd195d8-00eb-4a6c-9b0f-bd55db203d16 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:03.703649 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-ee6af559-d14c-4bbc-ac55-0757505956b3 req-0cd195d8-00eb-4a6c-9b0f-bd55db203d16 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:03.714761 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-ee6af559-d14c-4bbc-ac55-0757505956b3 req-0cd195d8-00eb-4a6c-9b0f-bd55db203d16 service nova] Creating event network-vif-deleted:8b3af3df-2524-4785-8ea4-ef0b84e6d32e for instance 67dbd32c-21f9-48b2-b4b2-74f37cce2d82 on hv-cinder-83607 May 26 17:00:03.719991 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-ee6af559-d14c-4bbc-ac55-0757505956b3 req-0cd195d8-00eb-4a6c-9b0f-bd55db203d16 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029960 May 26 17:00:03.720666 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 579/1165] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 17:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:00:04.263236 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6c477a87-5572-42a3-98be-9ba9a9f414e5 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:04.263868 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-6c477a87-5572-42a3-98be-9ba9a9f414e5 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 67dbd32c-21f9-48b2-b4b2-74f37cce2d82] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:04.270295 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6c477a87-5572-42a3-98be-9ba9a9f414e5 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:04.270748 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6c477a87-5572-42a3-98be-9ba9a9f414e5 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:04.271521 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6c477a87-5572-42a3-98be-9ba9a9f414e5 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:04.271960 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6c477a87-5572-42a3-98be-9ba9a9f414e5 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:04.305481 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6c477a87-5572-42a3-98be-9ba9a9f414e5 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:04.306082 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6c477a87-5572-42a3-98be-9ba9a9f414e5 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:04.306352 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.objects.instance [None req-6c477a87-5572-42a3-98be-9ba9a9f414e5 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lazy-loading 'fault' on Instance uuid 67dbd32c-21f9-48b2-b4b2-74f37cce2d82 {{(pid=124266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:00:04.348977 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-6c477a87-5572-42a3-98be-9ba9a9f414e5 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7a1fe832af4c83b4b969729d0721e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f08cba99b478db51729bf108ec901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:04.356476 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6c477a87-5572-42a3-98be-9ba9a9f414e5 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82" status: 200 len: 1232 microversion: 2.1 time: 0.098133 May 26 17:00:04.357078 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 587/1166] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 17:00:04 2022] GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82 => generated 1232 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:05.375381 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-d77e9a6c-be78-4462-b971-a1f4d3ea49bf tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:05.376092 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-d77e9a6c-be78-4462-b971-a1f4d3ea49bf tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 67dbd32c-21f9-48b2-b4b2-74f37cce2d82] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:05.382404 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d77e9a6c-be78-4462-b971-a1f4d3ea49bf tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:05.382862 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d77e9a6c-be78-4462-b971-a1f4d3ea49bf tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:05.383638 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d77e9a6c-be78-4462-b971-a1f4d3ea49bf tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:05.384078 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-d77e9a6c-be78-4462-b971-a1f4d3ea49bf tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:05.397328 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.wsgi [None req-d77e9a6c-be78-4462-b971-a1f4d3ea49bf tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] HTTP exception thrown: Instance 67dbd32c-21f9-48b2-b4b2-74f37cce2d82 could not be found. May 26 17:00:05.398959 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-d77e9a6c-be78-4462-b971-a1f4d3ea49bf tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Request method failure captured: May 26 17:00:05.398959 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: request: GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82 HTTP/1.1 May 26 17:00:05.398959 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept: application/json May 26 17:00:05.398959 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept-Encoding: identity May 26 17:00:05.398959 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Connection: close May 26 17:00:05.398959 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Length: 0 May 26 17:00:05.398959 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Type: application/json May 26 17:00:05.398959 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Host: 10.222.0.102 May 26 17:00:05.398959 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Openstack-System-Scope: None May 26 17:00:05.398959 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: User-Agent: python-urllib3/1.26.9 May 26 17:00:05.398959 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Auth-Token: gAAAAABij6-bCnz1krl3jvaMy3xBF_gVub4hyPORFSK_UZUqjMUnGopA_9vnLUGx7868E9wmXQ1i5XTbb8Ln3FLxLb13_-qyF56oOXfxAmPwNOJGO8o7u7A9EhqvrJzh-ml-alqWaq98EV8cXVkUt9_F5g-U7YzkZgUh57FsEKUyPEyHuepAcPU May 26 17:00:05.398959 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Id: None May 26 17:00:05.398959 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Name: None May 26 17:00:05.398959 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Identity-Status: Confirmed May 26 17:00:05.398959 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Is-Admin-Project: True May 26 17:00:05.398959 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Id: default May 26 17:00:05.398959 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Name: Default May 26 17:00:05.398959 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Id: 257f08cba99b478db51729bf108ec901 May 26 17:00:05.398959 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Name: tempest-TestVolumeBootPattern-2097601180 May 26 17:00:05.398959 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Role: reader,member May 26 17:00:05.398959 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Roles: reader,member May 26 17:00:05.400882 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/257f08cba99b478db51729bf108ec901"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/257f08cba99b478db51729bf108ec901"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/257f08cba99b478db51729bf108ec901"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_257f08cba99b478db51729bf108ec901"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 17:00:05.400882 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant: tempest-TestVolumeBootPattern-2097601180 May 26 17:00:05.400882 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Id: 257f08cba99b478db51729bf108ec901 May 26 17:00:05.400882 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Name: tempest-TestVolumeBootPattern-2097601180 May 26 17:00:05.400882 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User: tempest-TestVolumeBootPattern-2097601180-project May 26 17:00:05.400882 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Id: default May 26 17:00:05.400882 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Name: Default May 26 17:00:05.400882 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Id: 6f7a1fe832af4c83b4b969729d0721e9 May 26 17:00:05.400882 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Name: tempest-TestVolumeBootPattern-2097601180-project May 26 17:00:05.400882 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: method: > May 26 17:00:05.400882 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: exception: Instance 67dbd32c-21f9-48b2-b4b2-74f37cce2d82 could not be found. May 26 17:00:05.400882 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: action_args: {'id': '67dbd32c-21f9-48b2-b4b2-74f37cce2d82'} May 26 17:00:05.401886 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:00:05.401886 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:00:05.401886 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:00:05.401886 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:00:05.401886 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:00:05.401886 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:00:05.401886 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:00:05.401886 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:00:05.401886 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:00:05.401886 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:00:05.401886 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67dbd32c-21f9-48b2-b4b2-74f37cce2d82 could not be found. May 26 17:00:05.401886 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 17:00:05.401886 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:00:05.401886 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 17:00:05.401886 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:00:05.401886 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:00:05.401886 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:00:05.401886 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:00:05.401886 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:00:05.401886 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:00:05.403693 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:00:05.403693 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:00:05.403693 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:00:05.403693 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:00:05.403693 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:00:05.403693 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:00:05.403693 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:00:05.403693 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67dbd32c-21f9-48b2-b4b2-74f37cce2d82 could not be found. May 26 17:00:05.403693 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 17:00:05.403693 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:00:05.403693 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 17:00:05.403693 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:00:05.403693 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:00:05.403693 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:00:05.403693 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:00:05.403693 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:00:05.403693 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67dbd32c-21f9-48b2-b4b2-74f37cce2d82 could not be found. May 26 17:00:05.403693 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 17:00:05.405312 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-d77e9a6c-be78-4462-b971-a1f4d3ea49bf tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Returning 404 to user: Instance 67dbd32c-21f9-48b2-b4b2-74f37cce2d82 could not be found. {{(pid=124267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:00:05.405312 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-d77e9a6c-be78-4462-b971-a1f4d3ea49bf tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82" status: 404 len: 111 microversion: 2.1 time: 0.029749 May 26 17:00:05.405312 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 580/1167] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 17:00:05 2022] GET /compute/v2.1/servers/67dbd32c-21f9-48b2-b4b2-74f37cce2d82 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:00:05.831764 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-96b1e3ad-5ad2-4321-b1bb-0135943b4ffa tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:05.832294 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-96b1e3ad-5ad2-4321-b1bb-0135943b4ffa tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 66738af8-23b3-415c-8352-519823df5647] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:05.839223 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-96b1e3ad-5ad2-4321-b1bb-0135943b4ffa tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:05.839718 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-96b1e3ad-5ad2-4321-b1bb-0135943b4ffa tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:05.840507 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-96b1e3ad-5ad2-4321-b1bb-0135943b4ffa tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:05.840941 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-96b1e3ad-5ad2-4321-b1bb-0135943b4ffa tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:05.854822 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-96b1e3ad-5ad2-4321-b1bb-0135943b4ffa tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] HTTP exception thrown: Instance 66738af8-23b3-415c-8352-519823df5647 could not be found. May 26 17:00:05.856408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-96b1e3ad-5ad2-4321-b1bb-0135943b4ffa tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Request method failure captured: May 26 17:00:05.856408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: request: DELETE /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647 HTTP/1.1 May 26 17:00:05.856408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept: application/json May 26 17:00:05.856408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity May 26 17:00:05.856408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Connection: close May 26 17:00:05.856408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Length: 0 May 26 17:00:05.856408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Type: application/json May 26 17:00:05.856408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Host: 10.222.0.102 May 26 17:00:05.856408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None May 26 17:00:05.856408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 May 26 17:00:05.856408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABij6-bCnz1krl3jvaMy3xBF_gVub4hyPORFSK_UZUqjMUnGopA_9vnLUGx7868E9wmXQ1i5XTbb8Ln3FLxLb13_-qyF56oOXfxAmPwNOJGO8o7u7A9EhqvrJzh-ml-alqWaq98EV8cXVkUt9_F5g-U7YzkZgUh57FsEKUyPEyHuepAcPU May 26 17:00:05.856408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Id: None May 26 17:00:05.856408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Name: None May 26 17:00:05.856408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed May 26 17:00:05.856408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True May 26 17:00:05.856408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default May 26 17:00:05.856408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default May 26 17:00:05.856408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Id: 257f08cba99b478db51729bf108ec901 May 26 17:00:05.856408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-TestVolumeBootPattern-2097601180 May 26 17:00:05.856408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Role: reader,member May 26 17:00:05.856408 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Roles: reader,member May 26 17:00:05.858041 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/257f08cba99b478db51729bf108ec901"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/257f08cba99b478db51729bf108ec901"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/257f08cba99b478db51729bf108ec901"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_257f08cba99b478db51729bf108ec901"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 17:00:05.858041 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-TestVolumeBootPattern-2097601180 May 26 17:00:05.858041 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Id: 257f08cba99b478db51729bf108ec901 May 26 17:00:05.858041 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-TestVolumeBootPattern-2097601180 May 26 17:00:05.858041 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User: tempest-TestVolumeBootPattern-2097601180-project May 26 17:00:05.858041 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default May 26 17:00:05.858041 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default May 26 17:00:05.858041 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Id: 6f7a1fe832af4c83b4b969729d0721e9 May 26 17:00:05.858041 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-TestVolumeBootPattern-2097601180-project May 26 17:00:05.858041 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: method: > May 26 17:00:05.858041 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: exception: Instance 66738af8-23b3-415c-8352-519823df5647 could not be found. May 26 17:00:05.858041 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: action_args: {'id': '66738af8-23b3-415c-8352-519823df5647'} May 26 17:00:05.858989 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:00:05.858989 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:00:05.858989 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:00:05.858989 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:00:05.858989 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:00:05.858989 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:00:05.858989 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:00:05.858989 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:00:05.858989 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:00:05.858989 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:00:05.858989 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66738af8-23b3-415c-8352-519823df5647 could not be found. May 26 17:00:05.858989 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 17:00:05.858989 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:00:05.858989 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 17:00:05.858989 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:00:05.858989 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:00:05.858989 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:00:05.858989 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:00:05.858989 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:00:05.858989 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:00:05.860556 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:00:05.860556 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 17:00:05.860556 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 17:00:05.860556 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 17:00:05.860556 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 17:00:05.860556 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:00:05.860556 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:00:05.860556 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:00:05.860556 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:00:05.860556 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66738af8-23b3-415c-8352-519823df5647 could not be found. May 26 17:00:05.860556 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 17:00:05.860556 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:00:05.860556 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 17:00:05.860556 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:00:05.860556 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:00:05.860556 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:00:05.860556 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:00:05.860556 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:00:05.860556 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66738af8-23b3-415c-8352-519823df5647 could not be found. May 26 17:00:05.860556 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 17:00:05.862096 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-96b1e3ad-5ad2-4321-b1bb-0135943b4ffa tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Returning 404 to user: Instance 66738af8-23b3-415c-8352-519823df5647 could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:00:05.862096 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-96b1e3ad-5ad2-4321-b1bb-0135943b4ffa tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "DELETE /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647" status: 404 len: 111 microversion: 2.1 time: 0.029936 May 26 17:00:05.862096 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 588/1168] 10.222.0.102 () {58 vars in 1243 bytes} [Thu May 26 17:00:05 2022] DELETE /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:00:05.866775 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-ae8a16e6-c4a9-4320-b82f-02478ef01db1 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:05.867391 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-ae8a16e6-c4a9-4320-b82f-02478ef01db1 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] [instance: 66738af8-23b3-415c-8352-519823df5647] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:05.873507 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ae8a16e6-c4a9-4320-b82f-02478ef01db1 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:05.873957 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ae8a16e6-c4a9-4320-b82f-02478ef01db1 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:05.874729 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ae8a16e6-c4a9-4320-b82f-02478ef01db1 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:05.875169 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ae8a16e6-c4a9-4320-b82f-02478ef01db1 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:05.888767 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.wsgi [None req-ae8a16e6-c4a9-4320-b82f-02478ef01db1 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] HTTP exception thrown: Instance 66738af8-23b3-415c-8352-519823df5647 could not be found. May 26 17:00:05.890316 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-ae8a16e6-c4a9-4320-b82f-02478ef01db1 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Request method failure captured: May 26 17:00:05.890316 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: request: GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647 HTTP/1.1 May 26 17:00:05.890316 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept: application/json May 26 17:00:05.890316 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept-Encoding: identity May 26 17:00:05.890316 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Connection: close May 26 17:00:05.890316 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Length: 0 May 26 17:00:05.890316 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Type: application/json May 26 17:00:05.890316 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Host: 10.222.0.102 May 26 17:00:05.890316 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Openstack-System-Scope: None May 26 17:00:05.890316 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: User-Agent: python-urllib3/1.26.9 May 26 17:00:05.890316 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Auth-Token: gAAAAABij6-bCnz1krl3jvaMy3xBF_gVub4hyPORFSK_UZUqjMUnGopA_9vnLUGx7868E9wmXQ1i5XTbb8Ln3FLxLb13_-qyF56oOXfxAmPwNOJGO8o7u7A9EhqvrJzh-ml-alqWaq98EV8cXVkUt9_F5g-U7YzkZgUh57FsEKUyPEyHuepAcPU May 26 17:00:05.890316 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Id: None May 26 17:00:05.890316 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Name: None May 26 17:00:05.890316 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Identity-Status: Confirmed May 26 17:00:05.890316 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Is-Admin-Project: True May 26 17:00:05.890316 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Id: default May 26 17:00:05.890316 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Name: Default May 26 17:00:05.890316 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Id: 257f08cba99b478db51729bf108ec901 May 26 17:00:05.890316 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Name: tempest-TestVolumeBootPattern-2097601180 May 26 17:00:05.890316 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Role: reader,member May 26 17:00:05.890316 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Roles: reader,member May 26 17:00:05.892102 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/257f08cba99b478db51729bf108ec901"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/257f08cba99b478db51729bf108ec901"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/257f08cba99b478db51729bf108ec901"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_257f08cba99b478db51729bf108ec901"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 17:00:05.892102 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant: tempest-TestVolumeBootPattern-2097601180 May 26 17:00:05.892102 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Id: 257f08cba99b478db51729bf108ec901 May 26 17:00:05.892102 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Name: tempest-TestVolumeBootPattern-2097601180 May 26 17:00:05.892102 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User: tempest-TestVolumeBootPattern-2097601180-project May 26 17:00:05.892102 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Id: default May 26 17:00:05.892102 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Name: Default May 26 17:00:05.892102 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Id: 6f7a1fe832af4c83b4b969729d0721e9 May 26 17:00:05.892102 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Name: tempest-TestVolumeBootPattern-2097601180-project May 26 17:00:05.892102 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: method: > May 26 17:00:05.892102 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: exception: Instance 66738af8-23b3-415c-8352-519823df5647 could not be found. May 26 17:00:05.892102 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: action_args: {'id': '66738af8-23b3-415c-8352-519823df5647'} May 26 17:00:05.893112 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:00:05.893112 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:00:05.893112 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:00:05.893112 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:00:05.893112 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:00:05.893112 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:00:05.893112 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:00:05.893112 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:00:05.893112 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:00:05.893112 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:00:05.893112 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66738af8-23b3-415c-8352-519823df5647 could not be found. May 26 17:00:05.893112 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 17:00:05.893112 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:00:05.893112 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 17:00:05.893112 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:00:05.893112 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:00:05.893112 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:00:05.893112 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:00:05.893112 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:00:05.893112 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:00:05.894543 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:00:05.894543 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:00:05.894543 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:00:05.894543 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:00:05.894543 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:00:05.894543 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:00:05.894543 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:00:05.894543 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66738af8-23b3-415c-8352-519823df5647 could not be found. May 26 17:00:05.894543 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 17:00:05.894543 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:00:05.894543 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 17:00:05.894543 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:00:05.894543 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:00:05.894543 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:00:05.894543 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:00:05.894543 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:00:05.894543 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66738af8-23b3-415c-8352-519823df5647 could not be found. May 26 17:00:05.894543 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 17:00:05.895722 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-ae8a16e6-c4a9-4320-b82f-02478ef01db1 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Returning 404 to user: Instance 66738af8-23b3-415c-8352-519823df5647 could not be found. {{(pid=124267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:00:05.895722 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-ae8a16e6-c4a9-4320-b82f-02478ef01db1 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647" status: 404 len: 111 microversion: 2.1 time: 0.028913 May 26 17:00:05.895722 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 581/1169] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 17:00:05 2022] GET /compute/v2.1/servers/66738af8-23b3-415c-8352-519823df5647 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 17:00:07.193424 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-b0aa096a-7e00-4afe-bdf9-ab1dfecc8093 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] Calling method '.version_select at 0x7f93b4e35e50>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:07.218168 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-b0aa096a-7e00-4afe-bdf9-ab1dfecc8093 tempest-TestVolumeBootPattern-2097601180 tempest-TestVolumeBootPattern-2097601180-project] 10.222.0.102 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-902784053" status: 202 len: 0 microversion: 2.1 time: 0.028695 May 26 17:00:07.218736 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 589/1170] 10.222.0.102 () {58 vars in 1264 bytes} [Thu May 26 17:00:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-902784053 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:00:12.205333 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-ada080b9-a4f3-4154-a1c9-05f9bf993120 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9143b69-365e-4fb0-a97d-b2a3e3b9243d"}} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:00:12.206626 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-ada080b9-a4f3-4154-a1c9-05f9bf993120 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:12.213388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ada080b9-a4f3-4154-a1c9-05f9bf993120 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:12.214192 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ada080b9-a4f3-4154-a1c9-05f9bf993120 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:12.215222 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ada080b9-a4f3-4154-a1c9-05f9bf993120 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:12.215751 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ada080b9-a4f3-4154-a1c9-05f9bf993120 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:12.318126 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.wsgi [None req-ada080b9-a4f3-4154-a1c9-05f9bf993120 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] HTTP exception thrown: Invalid volume: volume a9143b69-365e-4fb0-a97d-b2a3e3b9243d is already attached to instances: 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 May 26 17:00:12.319932 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-ada080b9-a4f3-4154-a1c9-05f9bf993120 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Request method failure captured: May 26 17:00:12.319932 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: request: POST /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3/os-volume_attachments HTTP/1.1 May 26 17:00:12.319932 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept: application/json May 26 17:00:12.319932 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept-Encoding: identity May 26 17:00:12.319932 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Connection: close May 26 17:00:12.319932 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Length: 74 May 26 17:00:12.319932 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Type: application/json May 26 17:00:12.319932 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Host: 10.222.0.102 May 26 17:00:12.319932 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Openstack-System-Scope: None May 26 17:00:12.319932 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: User-Agent: python-urllib3/1.26.9 May 26 17:00:12.319932 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Auth-Token: gAAAAABij7BiyHwpXyrt5gouZdLSR2u247HLrYjemXZgQvKKvL_gKjh50uqCS18EIS9Fz-K4YX8tYAnNJ1wV14kiwAB02jbBtqzwSucC_mBuXxtMJigMQrPKQ8KbZZZS-Ddpdzpc4NsmLSF1WlBJg_r88uD0kjqGmk19u_c3hfGh7S_nxL5xe64 May 26 17:00:12.319932 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Id: None May 26 17:00:12.319932 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Name: None May 26 17:00:12.319932 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Identity-Status: Confirmed May 26 17:00:12.319932 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Is-Admin-Project: True May 26 17:00:12.319932 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Id: default May 26 17:00:12.319932 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Name: Default May 26 17:00:12.319932 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Id: c56b7ca2b1f54ae782302bead8a35b01 May 26 17:00:12.319932 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Name: tempest-AttachVolumeNegativeTest-482187288 May 26 17:00:12.319932 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Role: reader,member May 26 17:00:12.319932 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Roles: reader,member May 26 17:00:12.322035 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 17:00:12.322035 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant: tempest-AttachVolumeNegativeTest-482187288 May 26 17:00:12.322035 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Id: c56b7ca2b1f54ae782302bead8a35b01 May 26 17:00:12.322035 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-482187288 May 26 17:00:12.322035 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User: tempest-AttachVolumeNegativeTest-482187288-project May 26 17:00:12.322035 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Id: default May 26 17:00:12.322035 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Name: Default May 26 17:00:12.322035 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Id: 75cc85261ad441f8993877a959bdd97b May 26 17:00:12.322035 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Name: tempest-AttachVolumeNegativeTest-482187288-project May 26 17:00:12.322035 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: May 26 17:00:12.322035 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: {"volumeAttachment": {"volumeId": "a9143b69-365e-4fb0-a97d-b2a3e3b9243d"}} May 26 17:00:12.322035 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: method: > May 26 17:00:12.323099 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: exception: Invalid volume: volume a9143b69-365e-4fb0-a97d-b2a3e3b9243d is already attached to instances: 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 May 26 17:00:12.323099 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: action_args: {'server_id': '09cc4140-fc5a-40fb-a615-76e1a4e9f7d3', 'body': {'volumeAttachment': {'volumeId': 'a9143b69-365e-4fb0-a97d-b2a3e3b9243d'}}} May 26 17:00:12.323099 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:00:12.323099 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:00:12.323099 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 17:00:12.323099 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 17:00:12.323099 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 17:00:12.323099 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 17:00:12.323099 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 17:00:12.323099 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 17:00:12.323099 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 26 17:00:12.323099 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 26 17:00:12.323099 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 26 17:00:12.323099 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 26 17:00:12.323099 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a9143b69-365e-4fb0-a97d-b2a3e3b9243d is already attached to instances: 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 May 26 17:00:12.323099 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 17:00:12.323099 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:00:12.323099 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 17:00:12.323099 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:00:12.325417 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:00:12.325417 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:00:12.325417 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:00:12.325417 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:00:12.325417 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:00:12.325417 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:00:12.325417 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 17:00:12.325417 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 17:00:12.325417 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 17:00:12.325417 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 17:00:12.325417 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 17:00:12.325417 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 17:00:12.325417 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 26 17:00:12.325417 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 17:00:12.325417 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a9143b69-365e-4fb0-a97d-b2a3e3b9243d is already attached to instances: 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 May 26 17:00:12.325417 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 17:00:12.325417 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:00:12.325417 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 17:00:12.325417 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:00:12.325417 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:00:12.327527 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:00:12.327527 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:00:12.327527 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:00:12.327527 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a9143b69-365e-4fb0-a97d-b2a3e3b9243d is already attached to instances: 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 May 26 17:00:12.327527 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 17:00:12.327527 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-ada080b9-a4f3-4154-a1c9-05f9bf993120 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Returning 400 to user: Invalid volume: volume a9143b69-365e-4fb0-a97d-b2a3e3b9243d is already attached to instances: 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 {{(pid=124267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:00:12.327527 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-ada080b9-a4f3-4154-a1c9-05f9bf993120 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "POST /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.124089 May 26 17:00:12.332060 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 582/1171] 10.222.0.102 () {60 vars in 1327 bytes} [Thu May 26 17:00:12 2022] POST /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3/os-volume_attachments => generated 174 bytes in 128 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 17:00:12.398278 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-fc0f573a-12fd-464c-92a2-c28d88d39306 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:12.398840 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-fc0f573a-12fd-464c-92a2-c28d88d39306 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:12.405787 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fc0f573a-12fd-464c-92a2-c28d88d39306 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:12.406529 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fc0f573a-12fd-464c-92a2-c28d88d39306 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:12.407522 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fc0f573a-12fd-464c-92a2-c28d88d39306 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:12.407960 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-fc0f573a-12fd-464c-92a2-c28d88d39306 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:12.502319 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.objects.instance [None req-fc0f573a-12fd-464c-92a2-c28d88d39306 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lazy-loading 'services' on Instance uuid 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 {{(pid=124266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:00:12.592216 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-fc0f573a-12fd-464c-92a2-c28d88d39306 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "DELETE /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3/os-volume_attachments/a9143b69-365e-4fb0-a97d-b2a3e3b9243d" status: 202 len: 0 microversion: 2.1 time: 0.198813 May 26 17:00:12.593165 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 590/1172] 10.222.0.102 () {58 vars in 1420 bytes} [Thu May 26 17:00:12 2022] DELETE /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3/os-volume_attachments/a9143b69-365e-4fb0-a97d-b2a3e3b9243d => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:00:12.602312 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-2e6c3f9a-6db2-4ed6-aa80-a29c52fe279c tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:12.603307 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-2e6c3f9a-6db2-4ed6-aa80-a29c52fe279c tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:12.609497 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2e6c3f9a-6db2-4ed6-aa80-a29c52fe279c tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:12.610216 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2e6c3f9a-6db2-4ed6-aa80-a29c52fe279c tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:12.611175 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2e6c3f9a-6db2-4ed6-aa80-a29c52fe279c tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:12.611784 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2e6c3f9a-6db2-4ed6-aa80-a29c52fe279c tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:12.647351 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-2e6c3f9a-6db2-4ed6-aa80-a29c52fe279c tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049731 May 26 17:00:12.648986 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 583/1173] 10.222.0.102 () {58 vars in 1306 bytes} [Thu May 26 17:00:12 2022] GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:00:13.664775 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0f7c1197-60b4-4842-87bb-289419882703 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:13.665853 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0f7c1197-60b4-4842-87bb-289419882703 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:13.674269 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0f7c1197-60b4-4842-87bb-289419882703 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:13.675246 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0f7c1197-60b4-4842-87bb-289419882703 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:13.676281 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0f7c1197-60b4-4842-87bb-289419882703 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:13.677072 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0f7c1197-60b4-4842-87bb-289419882703 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:13.716101 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0f7c1197-60b4-4842-87bb-289419882703 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059966 May 26 17:00:13.716874 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 591/1174] 10.222.0.102 () {58 vars in 1306 bytes} [Thu May 26 17:00:13 2022] GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 17:00:13.808083 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-fcf2cdea-a256-4406-aa24-272939d0f257 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:13.809363 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-fcf2cdea-a256-4406-aa24-272939d0f257 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:13.817897 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fcf2cdea-a256-4406-aa24-272939d0f257 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:13.818542 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fcf2cdea-a256-4406-aa24-272939d0f257 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:13.819594 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fcf2cdea-a256-4406-aa24-272939d0f257 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:13.821041 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fcf2cdea-a256-4406-aa24-272939d0f257 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:13.895654 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-fcf2cdea-a256-4406-aa24-272939d0f257 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3] Going to try to terminate instance {{(pid=124267) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 17:00:14.010344 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-fcf2cdea-a256-4406-aa24-272939d0f257 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "DELETE /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3" status: 204 len: 0 microversion: 2.1 time: 0.209866 May 26 17:00:14.011067 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 584/1175] 10.222.0.102 () {58 vars in 1243 bytes} [Thu May 26 17:00:13 2022] DELETE /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 17:00:14.020182 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-53aebfd6-2f56-4a88-8d50-64a6886c0a3d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:14.020866 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-53aebfd6-2f56-4a88-8d50-64a6886c0a3d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:14.027701 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-53aebfd6-2f56-4a88-8d50-64a6886c0a3d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:14.028347 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-53aebfd6-2f56-4a88-8d50-64a6886c0a3d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:14.029158 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-53aebfd6-2f56-4a88-8d50-64a6886c0a3d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:14.029600 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-53aebfd6-2f56-4a88-8d50-64a6886c0a3d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:14.172110 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-53aebfd6-2f56-4a88-8d50-64a6886c0a3d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:14.180646 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-53aebfd6-2f56-4a88-8d50-64a6886c0a3d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3" status: 200 len: 1686 microversion: 2.1 time: 0.164580 May 26 17:00:14.181231 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 592/1176] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 17:00:14 2022] GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 => generated 1686 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:15.199196 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-ea69fe38-94f2-4ee0-8da8-8da8bdcdd661 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:15.199813 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-ea69fe38-94f2-4ee0-8da8-8da8bdcdd661 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:15.206499 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ea69fe38-94f2-4ee0-8da8-8da8bdcdd661 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:15.206954 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ea69fe38-94f2-4ee0-8da8-8da8bdcdd661 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:15.211913 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ea69fe38-94f2-4ee0-8da8-8da8bdcdd661 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:15.211913 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ea69fe38-94f2-4ee0-8da8-8da8bdcdd661 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:15.337713 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-ea69fe38-94f2-4ee0-8da8-8da8bdcdd661 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:15.345212 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-ea69fe38-94f2-4ee0-8da8-8da8bdcdd661 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3" status: 200 len: 1686 microversion: 2.1 time: 0.150367 May 26 17:00:15.345778 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 585/1177] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 17:00:15 2022] GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 => generated 1686 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:16.362920 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-f9e47776-06b8-4e32-a56d-fbe36ed4bdcb tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:16.363517 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-f9e47776-06b8-4e32-a56d-fbe36ed4bdcb tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:16.370888 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f9e47776-06b8-4e32-a56d-fbe36ed4bdcb tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:16.371335 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f9e47776-06b8-4e32-a56d-fbe36ed4bdcb tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:16.372164 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f9e47776-06b8-4e32-a56d-fbe36ed4bdcb tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:16.372665 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-f9e47776-06b8-4e32-a56d-fbe36ed4bdcb tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:16.599274 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-f9e47776-06b8-4e32-a56d-fbe36ed4bdcb tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:16.607512 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-f9e47776-06b8-4e32-a56d-fbe36ed4bdcb tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3" status: 200 len: 1686 microversion: 2.1 time: 0.248533 May 26 17:00:16.608091 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 593/1178] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 17:00:16 2022] GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 => generated 1686 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:16.992017 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-ac327b1c-5f85-48a8-a1f0-902f24b27aeb req-03207181-5339-49d5-bcb0-8c5e5a0e4d44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09cc4140-fc5a-40fb-a615-76e1a4e9f7d3", "name": "network-vif-deleted", "tag": "19061fb6-33c6-46e8-b9a1-9f5ce66988f7"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:00:17.003355 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-ac327b1c-5f85-48a8-a1f0-902f24b27aeb req-03207181-5339-49d5-bcb0-8c5e5a0e4d44 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:17.003792 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-ac327b1c-5f85-48a8-a1f0-902f24b27aeb req-03207181-5339-49d5-bcb0-8c5e5a0e4d44 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:17.016426 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-ac327b1c-5f85-48a8-a1f0-902f24b27aeb req-03207181-5339-49d5-bcb0-8c5e5a0e4d44 service nova] Creating event network-vif-deleted:19061fb6-33c6-46e8-b9a1-9f5ce66988f7 for instance 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 on hv-cinder-83607 May 26 17:00:17.021588 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-ac327b1c-5f85-48a8-a1f0-902f24b27aeb req-03207181-5339-49d5-bcb0-8c5e5a0e4d44 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033797 May 26 17:00:17.023121 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 586/1179] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 17:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:00:17.625916 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a4c4ebc3-9258-4e48-9181-f3c8dd75c201 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:17.626644 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-a4c4ebc3-9258-4e48-9181-f3c8dd75c201 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:17.633982 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a4c4ebc3-9258-4e48-9181-f3c8dd75c201 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:17.634436 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a4c4ebc3-9258-4e48-9181-f3c8dd75c201 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:17.635221 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a4c4ebc3-9258-4e48-9181-f3c8dd75c201 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:17.635664 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-a4c4ebc3-9258-4e48-9181-f3c8dd75c201 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:17.650513 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-a4c4ebc3-9258-4e48-9181-f3c8dd75c201 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] HTTP exception thrown: Instance 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 could not be found. May 26 17:00:17.652180 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a4c4ebc3-9258-4e48-9181-f3c8dd75c201 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Request method failure captured: May 26 17:00:17.652180 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 HTTP/1.1 May 26 17:00:17.652180 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept: application/json May 26 17:00:17.652180 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity May 26 17:00:17.652180 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Connection: close May 26 17:00:17.652180 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Length: 0 May 26 17:00:17.652180 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Type: application/json May 26 17:00:17.652180 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Host: 10.222.0.102 May 26 17:00:17.652180 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None May 26 17:00:17.652180 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 May 26 17:00:17.652180 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABij7BiyHwpXyrt5gouZdLSR2u247HLrYjemXZgQvKKvL_gKjh50uqCS18EIS9Fz-K4YX8tYAnNJ1wV14kiwAB02jbBtqzwSucC_mBuXxtMJigMQrPKQ8KbZZZS-Ddpdzpc4NsmLSF1WlBJg_r88uD0kjqGmk19u_c3hfGh7S_nxL5xe64 May 26 17:00:17.652180 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Id: None May 26 17:00:17.652180 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Name: None May 26 17:00:17.652180 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed May 26 17:00:17.652180 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True May 26 17:00:17.652180 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default May 26 17:00:17.652180 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default May 26 17:00:17.652180 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Id: c56b7ca2b1f54ae782302bead8a35b01 May 26 17:00:17.652180 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-AttachVolumeNegativeTest-482187288 May 26 17:00:17.652180 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Role: reader,member May 26 17:00:17.652180 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Roles: reader,member May 26 17:00:17.654716 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 17:00:17.654716 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-AttachVolumeNegativeTest-482187288 May 26 17:00:17.654716 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Id: c56b7ca2b1f54ae782302bead8a35b01 May 26 17:00:17.654716 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-482187288 May 26 17:00:17.654716 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User: tempest-AttachVolumeNegativeTest-482187288-project May 26 17:00:17.654716 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default May 26 17:00:17.654716 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default May 26 17:00:17.654716 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Id: 75cc85261ad441f8993877a959bdd97b May 26 17:00:17.654716 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-AttachVolumeNegativeTest-482187288-project May 26 17:00:17.654716 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: method: > May 26 17:00:17.654716 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: exception: Instance 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 could not be found. May 26 17:00:17.654716 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: action_args: {'id': '09cc4140-fc5a-40fb-a615-76e1a4e9f7d3'} May 26 17:00:17.655960 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:00:17.655960 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:00:17.655960 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:00:17.655960 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:00:17.655960 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:00:17.655960 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:00:17.655960 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:00:17.655960 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:00:17.655960 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:00:17.655960 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:00:17.655960 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 could not be found. May 26 17:00:17.655960 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 17:00:17.655960 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:00:17.655960 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 17:00:17.655960 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:00:17.655960 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:00:17.655960 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:00:17.655960 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:00:17.655960 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:00:17.655960 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:00:17.657657 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:00:17.657657 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:00:17.657657 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:00:17.657657 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:00:17.657657 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:00:17.657657 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:00:17.657657 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:00:17.657657 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 could not be found. May 26 17:00:17.657657 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 17:00:17.657657 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:00:17.657657 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 17:00:17.657657 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:00:17.657657 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:00:17.657657 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:00:17.657657 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:00:17.657657 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:00:17.657657 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 could not be found. May 26 17:00:17.657657 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 17:00:17.659082 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-a4c4ebc3-9258-4e48-9181-f3c8dd75c201 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Returning 404 to user: Instance 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:00:17.659082 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-a4c4ebc3-9258-4e48-9181-f3c8dd75c201 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3" status: 404 len: 111 microversion: 2.1 time: 0.031664 May 26 17:00:17.659082 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 594/1180] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 17:00:17 2022] GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:00:17.663717 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-2f957970-cfe5-43c0-bc50-2aa4a3fe5c24 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '.version_select at 0x7f93b08ae820>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:17.682518 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-2f957970-cfe5-43c0-bc50-2aa4a3fe5c24 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-134695234" status: 202 len: 0 microversion: 2.1 time: 0.022913 May 26 17:00:17.683116 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 587/1181] 10.222.0.102 () {58 vars in 1222 bytes} [Thu May 26 17:00:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-134695234 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:00:18.305102 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-69be932a-2eac-4827-a024-b7968e736bc3 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Action: 'create', calling method: .version_select at 0x7f93b4e35e50>, body: {"keypair": {"name": "tempest-keypair-1664505053", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0fwIhVdYcNyYPvylYh5pegD1yk0B956OTS5nEIhOQasHJZDloAIr1SPkP8c7Cb0HJ/kDQKnjkEnLcPsUBx5CL4uLZ9UKG5fmluKwZWGDXIWXq+8L2yJ+PKnGZzEcxfKg=="}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:00:18.319948 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-69be932a-2eac-4827-a024-b7968e736bc3 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Getting quotas for project c56b7ca2b1f54ae782302bead8a35b01. Resources: {'key_pairs'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:00:18.323798 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.quota [None req-69be932a-2eac-4827-a024-b7968e736bc3 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Getting quotas for user 75cc85261ad441f8993877a959bdd97b and project c56b7ca2b1f54ae782302bead8a35b01. Resources: {'key_pairs'} {{(pid=124266) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:00:18.345016 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-69be932a-2eac-4827-a024-b7968e736bc3 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044489 May 26 17:00:18.345603 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 595/1182] 10.222.0.102 () {60 vars in 1163 bytes} [Thu May 26 17:00:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:00:19.616778 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-685c40ac-eaf5-4a44-97f0-4cc6bc78439b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1292455853", "imageRef": "d74c4a51-21fe-41d5-865a-cb93604ac3aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1ef1a782-8a32-40c0-8c50-f68f3f393fb7"}], "security_groups": [{"name": "tempest-securitygroup--732627149"}], "key_name": "tempest-keypair-1664505053", "user_data": "}} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:00:19.720267 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.network.neutron [None req-685c40ac-eaf5-4a44-97f0-4cc6bc78439b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] validate_networks() for [('1ef1a782-8a32-40c0-8c50-f68f3f393fb7', None, None, None, None, None)] {{(pid=124267) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 17:00:20.345464 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-685c40ac-eaf5-4a44-97f0-4cc6bc78439b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Flavor limits 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 17:00:20.345908 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-685c40ac-eaf5-4a44-97f0-4cc6bc78439b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Image limits 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 17:00:20.346413 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-685c40ac-eaf5-4a44-97f0-4cc6bc78439b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Flavor pref 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 17:00:20.346828 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-685c40ac-eaf5-4a44-97f0-4cc6bc78439b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Image pref 0:0:0 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 17:00:20.347243 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.virt.hardware [None req-685c40ac-eaf5-4a44-97f0-4cc6bc78439b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 17:00:20.356793 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-685c40ac-eaf5-4a44-97f0-4cc6bc78439b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:20.357245 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-685c40ac-eaf5-4a44-97f0-4cc6bc78439b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:20.358055 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-685c40ac-eaf5-4a44-97f0-4cc6bc78439b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:20.358495 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-685c40ac-eaf5-4a44-97f0-4cc6bc78439b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:20.375885 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.quota [None req-685c40ac-eaf5-4a44-97f0-4cc6bc78439b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Getting quotas for project c56b7ca2b1f54ae782302bead8a35b01. Resources: {'cores', 'instances', 'ram'} {{(pid=124267) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:00:20.379859 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.quota [None req-685c40ac-eaf5-4a44-97f0-4cc6bc78439b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Getting quotas for user 75cc85261ad441f8993877a959bdd97b and project c56b7ca2b1f54ae782302bead8a35b01. Resources: {'cores', 'instances', 'ram'} {{(pid=124267) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:00:20.391002 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-685c40ac-eaf5-4a44-97f0-4cc6bc78439b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Going to run 1 instances... {{(pid=124267) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 17:00:20.393465 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-685c40ac-eaf5-4a44-97f0-4cc6bc78439b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 24c028a0-09ee-4151-b397-796cd8b211e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d74c4a51-21fe-41d5-865a-cb93604ac3aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 17:00:20.439760 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-685c40ac-eaf5-4a44-97f0-4cc6bc78439b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.827770 May 26 17:00:20.440864 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 588/1183] 10.222.0.102 () {60 vars in 1151 bytes} [Thu May 26 17:00:19 2022] POST /compute/v2.1/servers => generated 403 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 17:00:20.451490 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-4537d14d-2d81-469c-9cbb-02cfcbdcca11 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:20.452098 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-4537d14d-2d81-469c-9cbb-02cfcbdcca11 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 24c028a0-09ee-4151-b397-796cd8b211e3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:20.506516 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-4537d14d-2d81-469c-9cbb-02cfcbdcca11 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:20.513271 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-4537d14d-2d81-469c-9cbb-02cfcbdcca11 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3" status: 200 len: 1246 microversion: 2.1 time: 0.066452 May 26 17:00:20.513845 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 596/1184] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 17:00:20 2022] GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3 => generated 1246 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:21.530366 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-7f426a6c-8029-419c-a7e7-f55c7a01dc54 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:21.531017 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-7f426a6c-8029-419c-a7e7-f55c7a01dc54 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 24c028a0-09ee-4151-b397-796cd8b211e3] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:21.537903 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7f426a6c-8029-419c-a7e7-f55c7a01dc54 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:21.538357 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7f426a6c-8029-419c-a7e7-f55c7a01dc54 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:21.539129 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7f426a6c-8029-419c-a7e7-f55c7a01dc54 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:21.539561 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-7f426a6c-8029-419c-a7e7-f55c7a01dc54 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:21.617027 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-7f426a6c-8029-419c-a7e7-f55c7a01dc54 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:21.625036 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-7f426a6c-8029-419c-a7e7-f55c7a01dc54 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3" status: 200 len: 1304 microversion: 2.1 time: 0.098748 May 26 17:00:21.625617 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 589/1185] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 17:00:21 2022] GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:22.643031 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-01675f43-18d9-4b72-8daa-cfc3b3119c34 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:22.643837 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-01675f43-18d9-4b72-8daa-cfc3b3119c34 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 24c028a0-09ee-4151-b397-796cd8b211e3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:22.650952 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-01675f43-18d9-4b72-8daa-cfc3b3119c34 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:22.651488 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-01675f43-18d9-4b72-8daa-cfc3b3119c34 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:22.652828 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-01675f43-18d9-4b72-8daa-cfc3b3119c34 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:22.652828 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-01675f43-18d9-4b72-8daa-cfc3b3119c34 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:22.865751 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-01675f43-18d9-4b72-8daa-cfc3b3119c34 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:22.873403 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-01675f43-18d9-4b72-8daa-cfc3b3119c34 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3" status: 200 len: 1371 microversion: 2.1 time: 0.234360 May 26 17:00:22.873994 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 597/1186] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 17:00:22 2022] GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3 => generated 1371 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:22.983508 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-b5be5012-e7be-4c54-b68f-78499117bead req-c79130ed-913c-4b91-8178-e72b0de3f62e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24c028a0-09ee-4151-b397-796cd8b211e3", "tag": "d6e0f523-a0d4-43ac-a9c5-e85a17458cae"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:00:22.998715 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-b5be5012-e7be-4c54-b68f-78499117bead req-c79130ed-913c-4b91-8178-e72b0de3f62e service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:22.999589 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-b5be5012-e7be-4c54-b68f-78499117bead req-c79130ed-913c-4b91-8178-e72b0de3f62e service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:23.003973 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:23.013194 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-b5be5012-e7be-4c54-b68f-78499117bead req-c79130ed-913c-4b91-8178-e72b0de3f62e service nova] Creating event network-changed:d6e0f523-a0d4-43ac-a9c5-e85a17458cae for instance 24c028a0-09ee-4151-b397-796cd8b211e3 on hv-cinder-83607 May 26 17:00:23.018917 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-b5be5012-e7be-4c54-b68f-78499117bead req-c79130ed-913c-4b91-8178-e72b0de3f62e service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039340 May 26 17:00:23.020592 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 590/1187] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 17:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:00:23.890341 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-d7773321-ce09-4471-9b7c-144abafcdf45 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:23.891224 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-d7773321-ce09-4471-9b7c-144abafcdf45 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 24c028a0-09ee-4151-b397-796cd8b211e3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:23.894393 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:23.901261 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d7773321-ce09-4471-9b7c-144abafcdf45 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:23.901861 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d7773321-ce09-4471-9b7c-144abafcdf45 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:23.902955 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d7773321-ce09-4471-9b7c-144abafcdf45 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:23.903399 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-d7773321-ce09-4471-9b7c-144abafcdf45 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:23.908070 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:24.045392 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-d7773321-ce09-4471-9b7c-144abafcdf45 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:24.052865 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-d7773321-ce09-4471-9b7c-144abafcdf45 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3" status: 200 len: 1371 microversion: 2.1 time: 0.166435 May 26 17:00:24.053370 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 598/1188] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 17:00:23 2022] GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:25.071982 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-ec0f45c5-423c-4b17-b11b-bece49bda97b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:25.072618 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-ec0f45c5-423c-4b17-b11b-bece49bda97b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 24c028a0-09ee-4151-b397-796cd8b211e3] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:25.074796 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:25.080355 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ec0f45c5-423c-4b17-b11b-bece49bda97b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:25.080822 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ec0f45c5-423c-4b17-b11b-bece49bda97b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:25.081579 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ec0f45c5-423c-4b17-b11b-bece49bda97b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:25.082008 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ec0f45c5-423c-4b17-b11b-bece49bda97b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:25.211480 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-ec0f45c5-423c-4b17-b11b-bece49bda97b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:25.218972 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-ec0f45c5-423c-4b17-b11b-bece49bda97b tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3" status: 200 len: 1371 microversion: 2.1 time: 0.152339 May 26 17:00:25.219551 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 591/1189] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 17:00:25 2022] GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:26.235850 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ed5775da-e45b-41fc-b549-2c8e67e0b0f5 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:26.236496 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ed5775da-e45b-41fc-b549-2c8e67e0b0f5 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 24c028a0-09ee-4151-b397-796cd8b211e3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:26.243672 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ed5775da-e45b-41fc-b549-2c8e67e0b0f5 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:26.244128 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ed5775da-e45b-41fc-b549-2c8e67e0b0f5 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:26.245005 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ed5775da-e45b-41fc-b549-2c8e67e0b0f5 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:26.245440 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ed5775da-e45b-41fc-b549-2c8e67e0b0f5 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:26.387222 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ed5775da-e45b-41fc-b549-2c8e67e0b0f5 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:26.394727 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ed5775da-e45b-41fc-b549-2c8e67e0b0f5 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3" status: 200 len: 1371 microversion: 2.1 time: 0.162841 May 26 17:00:26.395297 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 599/1190] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 17:00:26 2022] GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:27.411030 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-72a80cba-9459-4b98-9f37-d0f4f59a671f tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:27.411635 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-72a80cba-9459-4b98-9f37-d0f4f59a671f tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 24c028a0-09ee-4151-b397-796cd8b211e3] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:27.418557 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-72a80cba-9459-4b98-9f37-d0f4f59a671f tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:27.418997 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-72a80cba-9459-4b98-9f37-d0f4f59a671f tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:27.419750 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-72a80cba-9459-4b98-9f37-d0f4f59a671f tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:27.420232 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-72a80cba-9459-4b98-9f37-d0f4f59a671f tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:27.559842 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-72a80cba-9459-4b98-9f37-d0f4f59a671f tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:27.567862 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-72a80cba-9459-4b98-9f37-d0f4f59a671f tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3" status: 200 len: 1371 microversion: 2.1 time: 0.160483 May 26 17:00:27.568225 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 592/1191] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 17:00:27 2022] GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:28.584570 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0343d6bb-ac38-49ce-8c1f-3dd073e24987 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:28.585121 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0343d6bb-ac38-49ce-8c1f-3dd073e24987 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 24c028a0-09ee-4151-b397-796cd8b211e3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:28.592065 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0343d6bb-ac38-49ce-8c1f-3dd073e24987 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:28.592549 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0343d6bb-ac38-49ce-8c1f-3dd073e24987 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:28.593313 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0343d6bb-ac38-49ce-8c1f-3dd073e24987 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:28.593745 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0343d6bb-ac38-49ce-8c1f-3dd073e24987 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:28.721171 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-0343d6bb-ac38-49ce-8c1f-3dd073e24987 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:28.729340 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0343d6bb-ac38-49ce-8c1f-3dd073e24987 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3" status: 200 len: 1371 microversion: 2.1 time: 0.148129 May 26 17:00:28.729934 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 600/1192] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 17:00:28 2022] GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:28.942129 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-426c699c-21ef-49da-9994-31f7f8a12639 req-fde5755e-a63a-4de5-83c9-76460fd76791 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24c028a0-09ee-4151-b397-796cd8b211e3", "name": "network-vif-plugged", "status": "completed", "tag": "d6e0f523-a0d4-43ac-a9c5-e85a17458cae"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:00:28.951686 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-426c699c-21ef-49da-9994-31f7f8a12639 req-fde5755e-a63a-4de5-83c9-76460fd76791 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:28.952133 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-426c699c-21ef-49da-9994-31f7f8a12639 req-fde5755e-a63a-4de5-83c9-76460fd76791 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:28.964896 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-426c699c-21ef-49da-9994-31f7f8a12639 req-fde5755e-a63a-4de5-83c9-76460fd76791 service nova] Creating event network-vif-plugged:d6e0f523-a0d4-43ac-a9c5-e85a17458cae for instance 24c028a0-09ee-4151-b397-796cd8b211e3 on hv-cinder-83607 May 26 17:00:28.970003 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-426c699c-21ef-49da-9994-31f7f8a12639 req-fde5755e-a63a-4de5-83c9-76460fd76791 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031574 May 26 17:00:28.970635 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 593/1193] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 17:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:00:29.746799 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-df9fe233-f3f6-4f4a-9119-b5b8e7e7643e tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:29.747416 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-df9fe233-f3f6-4f4a-9119-b5b8e7e7643e tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 24c028a0-09ee-4151-b397-796cd8b211e3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:29.753872 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-df9fe233-f3f6-4f4a-9119-b5b8e7e7643e tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:29.754324 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-df9fe233-f3f6-4f4a-9119-b5b8e7e7643e tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:29.755085 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-df9fe233-f3f6-4f4a-9119-b5b8e7e7643e tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:29.755525 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-df9fe233-f3f6-4f4a-9119-b5b8e7e7643e tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:29.886365 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-df9fe233-f3f6-4f4a-9119-b5b8e7e7643e tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:29.893841 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-df9fe233-f3f6-4f4a-9119-b5b8e7e7643e tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3" status: 200 len: 1371 microversion: 2.1 time: 0.151597 May 26 17:00:29.894413 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 601/1194] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 17:00:29 2022] GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:30.911417 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-13a0acae-b5e7-45e0-b2dc-2554c79f8b24 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:30.912085 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-13a0acae-b5e7-45e0-b2dc-2554c79f8b24 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 24c028a0-09ee-4151-b397-796cd8b211e3] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:30.914436 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell0:SELECT=2 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:30.915094 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell0:SELECT=6 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:30.921341 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-13a0acae-b5e7-45e0-b2dc-2554c79f8b24 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:30.921795 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-13a0acae-b5e7-45e0-b2dc-2554c79f8b24 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:30.922563 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-13a0acae-b5e7-45e0-b2dc-2554c79f8b24 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:30.922994 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-13a0acae-b5e7-45e0-b2dc-2554c79f8b24 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:31.052282 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-13a0acae-b5e7-45e0-b2dc-2554c79f8b24 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:31.060405 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-13a0acae-b5e7-45e0-b2dc-2554c79f8b24 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3" status: 200 len: 1371 microversion: 2.1 time: 0.153411 May 26 17:00:31.060987 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 594/1195] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 17:00:30 2022] GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:32.077647 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-870ab5ce-1845-4f34-bdf0-fef80a01a046 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:32.078256 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-870ab5ce-1845-4f34-bdf0-fef80a01a046 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 24c028a0-09ee-4151-b397-796cd8b211e3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:32.080094 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell0:SELECT=6 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:32.085762 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-870ab5ce-1845-4f34-bdf0-fef80a01a046 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:32.086213 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-870ab5ce-1845-4f34-bdf0-fef80a01a046 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:32.086973 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-870ab5ce-1845-4f34-bdf0-fef80a01a046 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:32.087409 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-870ab5ce-1845-4f34-bdf0-fef80a01a046 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:32.217702 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-870ab5ce-1845-4f34-bdf0-fef80a01a046 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:32.225382 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-870ab5ce-1845-4f34-bdf0-fef80a01a046 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3" status: 200 len: 1562 microversion: 2.1 time: 0.151673 May 26 17:00:32.225944 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 602/1196] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 17:00:32 2022] GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:32.242273 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-ec6c4eb4-8c3d-4691-b5d2-139ebe427739 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:32.242784 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-ec6c4eb4-8c3d-4691-b5d2-139ebe427739 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 24c028a0-09ee-4151-b397-796cd8b211e3] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:32.249277 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ec6c4eb4-8c3d-4691-b5d2-139ebe427739 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:32.249731 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ec6c4eb4-8c3d-4691-b5d2-139ebe427739 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:32.250499 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ec6c4eb4-8c3d-4691-b5d2-139ebe427739 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:32.250935 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-ec6c4eb4-8c3d-4691-b5d2-139ebe427739 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:32.328763 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-ec6c4eb4-8c3d-4691-b5d2-139ebe427739 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090291 May 26 17:00:32.329304 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 595/1197] 10.222.0.102 () {58 vars in 1279 bytes} [Thu May 26 17:00:32 2022] GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:00:33.242737 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [req-7b4b07a8-f01c-4b2b-a873-ef96e936ab75 req-cda32986-40c9-4295-bf5c-e17289798d19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24c028a0-09ee-4151-b397-796cd8b211e3", "tag": "d6e0f523-a0d4-43ac-a9c5-e85a17458cae"}]} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:00:33.251385 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-7b4b07a8-f01c-4b2b-a873-ef96e936ab75 req-cda32986-40c9-4295-bf5c-e17289798d19 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:33.251831 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [req-7b4b07a8-f01c-4b2b-a873-ef96e936ab75 req-cda32986-40c9-4295-bf5c-e17289798d19 service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:33.262927 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.compute.server_external_events [req-7b4b07a8-f01c-4b2b-a873-ef96e936ab75 req-cda32986-40c9-4295-bf5c-e17289798d19 service nova] Creating event network-changed:d6e0f523-a0d4-43ac-a9c5-e85a17458cae for instance 24c028a0-09ee-4151-b397-796cd8b211e3 on hv-cinder-83607 May 26 17:00:33.267857 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [req-7b4b07a8-f01c-4b2b-a873-ef96e936ab75 req-cda32986-40c9-4295-bf5c-e17289798d19 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028868 May 26 17:00:33.268478 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 603/1198] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 17:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:01:17.349621 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 17:01:17.350302 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Thu May 26 17:01:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 17:01:59.862241 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_api:SELECT=9 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:59.863037 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=24 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:59.867844 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-8e9675f5-37e4-4e39-9c13-4297d5e13d81 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:59.868340 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-8e9675f5-37e4-4e39-9c13-4297d5e13d81 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 24c028a0-09ee-4151-b397-796cd8b211e3] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:59.875031 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8e9675f5-37e4-4e39-9c13-4297d5e13d81 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:59.875481 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8e9675f5-37e4-4e39-9c13-4297d5e13d81 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:59.876273 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8e9675f5-37e4-4e39-9c13-4297d5e13d81 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:59.876763 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8e9675f5-37e4-4e39-9c13-4297d5e13d81 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:59.899699 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-8e9675f5-37e4-4e39-9c13-4297d5e13d81 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3/ips" status: 200 len: 151 microversion: 2.1 time: 0.039819 May 26 17:01:59.900261 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 596/1199] 10.222.0.102 () {58 vars in 1252 bytes} [Thu May 26 17:01:59 2022] GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:02.254399 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_api:SELECT=11 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:02.255142 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG dbcounter [-] [124266] Writing DB stats nova_cell1:SELECT=31 {{(pid=124266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:02.261069 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-6d6176bb-4f9a-4054-849c-a74ac34ccae7 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4edd125-0d21-4931-80a2-e7360a2ad071"}} {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:02:02.262225 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-6d6176bb-4f9a-4054-849c-a74ac34ccae7 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 24c028a0-09ee-4151-b397-796cd8b211e3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:02.269204 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6d6176bb-4f9a-4054-849c-a74ac34ccae7 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:02.269657 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6d6176bb-4f9a-4054-849c-a74ac34ccae7 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:02.270426 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6d6176bb-4f9a-4054-849c-a74ac34ccae7 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:02.270868 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-6d6176bb-4f9a-4054-849c-a74ac34ccae7 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:02.684887 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-6d6176bb-4f9a-4054-849c-a74ac34ccae7 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "POST /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.432278 May 26 17:02:02.685523 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 604/1200] 10.222.0.102 () {60 vars in 1327 bytes} [Thu May 26 17:02:02 2022] POST /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3/os-volume_attachments => generated 194 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:10.279313 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-42288692-c9ad-4b2c-90fd-6f1734066c12 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:10.279857 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-42288692-c9ad-4b2c-90fd-6f1734066c12 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 24c028a0-09ee-4151-b397-796cd8b211e3] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:10.282150 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_api:SELECT=2 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:10.282786 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG dbcounter [-] [124267] Writing DB stats nova_cell1:SELECT=4 {{(pid=124267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:10.288181 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-42288692-c9ad-4b2c-90fd-6f1734066c12 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:10.288662 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-42288692-c9ad-4b2c-90fd-6f1734066c12 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:10.289416 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-42288692-c9ad-4b2c-90fd-6f1734066c12 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:10.289847 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-42288692-c9ad-4b2c-90fd-6f1734066c12 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:10.427992 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.objects.instance [None req-42288692-c9ad-4b2c-90fd-6f1734066c12 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lazy-loading 'services' on Instance uuid 24c028a0-09ee-4151-b397-796cd8b211e3 {{(pid=124267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:02:10.504478 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-42288692-c9ad-4b2c-90fd-6f1734066c12 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "DELETE /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3/os-volume_attachments/b4edd125-0d21-4931-80a2-e7360a2ad071" status: 202 len: 0 microversion: 2.1 time: 0.228911 May 26 17:02:10.505109 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 597/1201] 10.222.0.102 () {58 vars in 1420 bytes} [Thu May 26 17:02:10 2022] DELETE /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3/os-volume_attachments/b4edd125-0d21-4931-80a2-e7360a2ad071 => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:02:10.515370 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0f9c736f-2028-4fde-8a52-46a7f06eb4fb tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:10.516498 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0f9c736f-2028-4fde-8a52-46a7f06eb4fb tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 24c028a0-09ee-4151-b397-796cd8b211e3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:10.523264 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0f9c736f-2028-4fde-8a52-46a7f06eb4fb tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:10.523717 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0f9c736f-2028-4fde-8a52-46a7f06eb4fb tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:10.524508 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0f9c736f-2028-4fde-8a52-46a7f06eb4fb tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:10.524952 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0f9c736f-2028-4fde-8a52-46a7f06eb4fb tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:10.559735 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0f9c736f-2028-4fde-8a52-46a7f06eb4fb tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049107 May 26 17:02:10.560295 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 605/1202] 10.222.0.102 () {58 vars in 1306 bytes} [Thu May 26 17:02:10 2022] GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:11.572725 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-dbb300a8-3ae3-4149-a7a2-9ca8d27d2747 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:11.573687 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-dbb300a8-3ae3-4149-a7a2-9ca8d27d2747 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 24c028a0-09ee-4151-b397-796cd8b211e3] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:11.579850 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-dbb300a8-3ae3-4149-a7a2-9ca8d27d2747 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:11.580308 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-dbb300a8-3ae3-4149-a7a2-9ca8d27d2747 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:11.581103 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-dbb300a8-3ae3-4149-a7a2-9ca8d27d2747 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:11.581550 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-dbb300a8-3ae3-4149-a7a2-9ca8d27d2747 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:11.610537 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-dbb300a8-3ae3-4149-a7a2-9ca8d27d2747 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043025 May 26 17:02:11.611091 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 598/1203] 10.222.0.102 () {58 vars in 1306 bytes} [Thu May 26 17:02:11 2022] GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:12.625558 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-705c129f-15e6-4f8a-8b53-0468a17925ca tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:12.627055 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-705c129f-15e6-4f8a-8b53-0468a17925ca tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 24c028a0-09ee-4151-b397-796cd8b211e3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:12.638619 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-705c129f-15e6-4f8a-8b53-0468a17925ca tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:12.639150 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-705c129f-15e6-4f8a-8b53-0468a17925ca tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:12.639926 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-705c129f-15e6-4f8a-8b53-0468a17925ca tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:12.640384 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-705c129f-15e6-4f8a-8b53-0468a17925ca tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:12.668870 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-705c129f-15e6-4f8a-8b53-0468a17925ca tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050210 May 26 17:02:12.669434 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 606/1204] 10.222.0.102 () {58 vars in 1306 bytes} [Thu May 26 17:02:12 2022] GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 17:02:12.726412 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-8eca4c77-e193-4931-9ce8-444c37f6f843 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:12.726925 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-8eca4c77-e193-4931-9ce8-444c37f6f843 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 24c028a0-09ee-4151-b397-796cd8b211e3] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:12.733035 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8eca4c77-e193-4931-9ce8-444c37f6f843 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:12.733483 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8eca4c77-e193-4931-9ce8-444c37f6f843 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:12.734240 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8eca4c77-e193-4931-9ce8-444c37f6f843 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:12.734674 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-8eca4c77-e193-4931-9ce8-444c37f6f843 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:12.759622 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-8eca4c77-e193-4931-9ce8-444c37f6f843 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 24c028a0-09ee-4151-b397-796cd8b211e3] Going to try to terminate instance {{(pid=124267) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 17:02:12.852956 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-8eca4c77-e193-4931-9ce8-444c37f6f843 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "DELETE /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3" status: 204 len: 0 microversion: 2.1 time: 0.130069 May 26 17:02:12.853549 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 599/1205] 10.222.0.102 () {58 vars in 1243 bytes} [Thu May 26 17:02:12 2022] DELETE /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 17:02:12.862822 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-35ad1b03-f460-4628-9ab2-9024d646b321 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:12.863433 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-35ad1b03-f460-4628-9ab2-9024d646b321 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 24c028a0-09ee-4151-b397-796cd8b211e3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:12.869931 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-35ad1b03-f460-4628-9ab2-9024d646b321 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:12.870396 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-35ad1b03-f460-4628-9ab2-9024d646b321 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:12.871151 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-35ad1b03-f460-4628-9ab2-9024d646b321 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:12.871584 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-35ad1b03-f460-4628-9ab2-9024d646b321 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:13.003334 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-35ad1b03-f460-4628-9ab2-9024d646b321 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:13.011431 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-35ad1b03-f460-4628-9ab2-9024d646b321 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3" status: 200 len: 1687 microversion: 2.1 time: 0.152863 May 26 17:02:13.012314 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 607/1206] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 17:02:12 2022] GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3 => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:14.029543 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-2fa57ae4-130c-4c95-96f3-f493304d9ec7 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:14.030246 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-2fa57ae4-130c-4c95-96f3-f493304d9ec7 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 24c028a0-09ee-4151-b397-796cd8b211e3] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:14.036699 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2fa57ae4-130c-4c95-96f3-f493304d9ec7 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:14.037155 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2fa57ae4-130c-4c95-96f3-f493304d9ec7 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:14.037923 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2fa57ae4-130c-4c95-96f3-f493304d9ec7 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:14.038365 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-2fa57ae4-130c-4c95-96f3-f493304d9ec7 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:14.167175 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.policy [None req-2fa57ae4-130c-4c95-96f3-f493304d9ec7 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124267) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:14.174653 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-2fa57ae4-130c-4c95-96f3-f493304d9ec7 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3" status: 200 len: 1687 microversion: 2.1 time: 0.149381 May 26 17:02:14.175224 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 600/1207] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 17:02:14 2022] GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3 => generated 1687 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:15.193198 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-ac1b1b58-b3f5-482d-a4d8-7c4859b0e7c9 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:15.194209 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-ac1b1b58-b3f5-482d-a4d8-7c4859b0e7c9 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 24c028a0-09ee-4151-b397-796cd8b211e3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:15.200671 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ac1b1b58-b3f5-482d-a4d8-7c4859b0e7c9 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:15.201118 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ac1b1b58-b3f5-482d-a4d8-7c4859b0e7c9 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:15.201878 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ac1b1b58-b3f5-482d-a4d8-7c4859b0e7c9 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:15.202309 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-ac1b1b58-b3f5-482d-a4d8-7c4859b0e7c9 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:15.697560 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.policy [None req-ac1b1b58-b3f5-482d-a4d8-7c4859b0e7c9 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cc85261ad441f8993877a959bdd97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b7ca2b1f54ae782302bead8a35b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124266) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:15.705029 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-ac1b1b58-b3f5-482d-a4d8-7c4859b0e7c9 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3" status: 200 len: 1687 microversion: 2.1 time: 0.515662 May 26 17:02:15.705793 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 608/1208] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 17:02:15 2022] GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3 => generated 1687 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:16.139549 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [req-2794f958-949a-439d-8ec6-dcb15c9781a0 req-53d53b7c-2913-4237-acea-61b18280a2fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24c028a0-09ee-4151-b397-796cd8b211e3", "name": "network-vif-deleted", "tag": "d6e0f523-a0d4-43ac-a9c5-e85a17458cae"}]} {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:02:16.151060 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-2794f958-949a-439d-8ec6-dcb15c9781a0 req-53d53b7c-2913-4237-acea-61b18280a2fd service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:16.151851 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [req-2794f958-949a-439d-8ec6-dcb15c9781a0 req-53d53b7c-2913-4237-acea-61b18280a2fd service nova] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:16.173461 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.compute.server_external_events [req-2794f958-949a-439d-8ec6-dcb15c9781a0 req-53d53b7c-2913-4237-acea-61b18280a2fd service nova] Creating event network-vif-deleted:d6e0f523-a0d4-43ac-a9c5-e85a17458cae for instance 24c028a0-09ee-4151-b397-796cd8b211e3 on hv-cinder-83607 May 26 17:02:16.179226 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [req-2794f958-949a-439d-8ec6-dcb15c9781a0 req-53d53b7c-2913-4237-acea-61b18280a2fd service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044637 May 26 17:02:16.180968 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 601/1209] 10.222.0.102 () {64 vars in 1322 bytes} [Thu May 26 17:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:16.722745 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7942f8da-efa1-44ec-983e-fbbc84290f4e tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:16.723349 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-7942f8da-efa1-44ec-983e-fbbc84290f4e tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 24c028a0-09ee-4151-b397-796cd8b211e3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:16.729698 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7942f8da-efa1-44ec-983e-fbbc84290f4e tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:16.730138 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7942f8da-efa1-44ec-983e-fbbc84290f4e tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:16.731000 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7942f8da-efa1-44ec-983e-fbbc84290f4e tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:16.731463 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-7942f8da-efa1-44ec-983e-fbbc84290f4e tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:16.745541 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-7942f8da-efa1-44ec-983e-fbbc84290f4e tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] HTTP exception thrown: Instance 24c028a0-09ee-4151-b397-796cd8b211e3 could not be found. May 26 17:02:16.747340 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7942f8da-efa1-44ec-983e-fbbc84290f4e tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Request method failure captured: May 26 17:02:16.747340 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: request: GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3 HTTP/1.1 May 26 17:02:16.747340 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept: application/json May 26 17:02:16.747340 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity May 26 17:02:16.747340 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Connection: close May 26 17:02:16.747340 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Length: 0 May 26 17:02:16.747340 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Type: application/json May 26 17:02:16.747340 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Host: 10.222.0.102 May 26 17:02:16.747340 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None May 26 17:02:16.747340 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 May 26 17:02:16.747340 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABij7BiyHwpXyrt5gouZdLSR2u247HLrYjemXZgQvKKvL_gKjh50uqCS18EIS9Fz-K4YX8tYAnNJ1wV14kiwAB02jbBtqzwSucC_mBuXxtMJigMQrPKQ8KbZZZS-Ddpdzpc4NsmLSF1WlBJg_r88uD0kjqGmk19u_c3hfGh7S_nxL5xe64 May 26 17:02:16.747340 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Id: None May 26 17:02:16.747340 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Name: None May 26 17:02:16.747340 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed May 26 17:02:16.747340 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True May 26 17:02:16.747340 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default May 26 17:02:16.747340 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default May 26 17:02:16.747340 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Id: c56b7ca2b1f54ae782302bead8a35b01 May 26 17:02:16.747340 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-AttachVolumeNegativeTest-482187288 May 26 17:02:16.747340 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Role: reader,member May 26 17:02:16.747340 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Roles: reader,member May 26 17:02:16.749175 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 17:02:16.749175 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-AttachVolumeNegativeTest-482187288 May 26 17:02:16.749175 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Id: c56b7ca2b1f54ae782302bead8a35b01 May 26 17:02:16.749175 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-482187288 May 26 17:02:16.749175 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User: tempest-AttachVolumeNegativeTest-482187288-project May 26 17:02:16.749175 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default May 26 17:02:16.749175 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default May 26 17:02:16.749175 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Id: 75cc85261ad441f8993877a959bdd97b May 26 17:02:16.749175 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-AttachVolumeNegativeTest-482187288-project May 26 17:02:16.749175 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: method: > May 26 17:02:16.749175 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: exception: Instance 24c028a0-09ee-4151-b397-796cd8b211e3 could not be found. May 26 17:02:16.749175 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: action_args: {'id': '24c028a0-09ee-4151-b397-796cd8b211e3'} May 26 17:02:16.753537 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:02:16.753537 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:16.753537 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:02:16.753537 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:02:16.753537 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:02:16.753537 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:02:16.753537 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:02:16.753537 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:02:16.753537 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:02:16.753537 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:02:16.753537 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24c028a0-09ee-4151-b397-796cd8b211e3 could not be found. May 26 17:02:16.753537 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 17:02:16.753537 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:16.753537 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 17:02:16.753537 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:16.753537 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:16.753537 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:16.753537 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:02:16.753537 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:02:16.753537 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:02:16.755239 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:02:16.755239 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:02:16.755239 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:02:16.755239 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:02:16.755239 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:02:16.755239 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:02:16.755239 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:02:16.755239 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24c028a0-09ee-4151-b397-796cd8b211e3 could not be found. May 26 17:02:16.755239 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 17:02:16.755239 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:16.755239 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 17:02:16.755239 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:16.755239 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:16.755239 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:16.755239 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:02:16.755239 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:02:16.755239 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24c028a0-09ee-4151-b397-796cd8b211e3 could not be found. May 26 17:02:16.755239 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 17:02:16.757525 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-7942f8da-efa1-44ec-983e-fbbc84290f4e tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Returning 404 to user: Instance 24c028a0-09ee-4151-b397-796cd8b211e3 could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:02:16.757525 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-7942f8da-efa1-44ec-983e-fbbc84290f4e tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3" status: 404 len: 111 microversion: 2.1 time: 0.029926 May 26 17:02:16.757525 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 609/1210] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 17:02:16 2022] GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:02:16.762120 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-55c8fb6e-cb7e-4707-9385-ab04592d8159 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '.version_select at 0x7f93a3e06550>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:16.781639 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-55c8fb6e-cb7e-4707-9385-ab04592d8159 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1664505053" status: 202 len: 0 microversion: 2.1 time: 0.026449 May 26 17:02:16.782226 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 602/1211] 10.222.0.102 () {58 vars in 1225 bytes} [Thu May 26 17:02:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1664505053 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:02:18.542133 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0b827c3a-c122-4feb-97b9-9ec12898cfdd tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:18.542637 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-0b827c3a-c122-4feb-97b9-9ec12898cfdd tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 24c028a0-09ee-4151-b397-796cd8b211e3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:18.549756 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0b827c3a-c122-4feb-97b9-9ec12898cfdd tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:18.550213 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0b827c3a-c122-4feb-97b9-9ec12898cfdd tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:18.550985 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0b827c3a-c122-4feb-97b9-9ec12898cfdd tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:18.551424 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-0b827c3a-c122-4feb-97b9-9ec12898cfdd tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:18.565153 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-0b827c3a-c122-4feb-97b9-9ec12898cfdd tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] HTTP exception thrown: Instance 24c028a0-09ee-4151-b397-796cd8b211e3 could not be found. May 26 17:02:18.566630 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0b827c3a-c122-4feb-97b9-9ec12898cfdd tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Request method failure captured: May 26 17:02:18.566630 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: request: DELETE /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3 HTTP/1.1 May 26 17:02:18.566630 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept: application/json May 26 17:02:18.566630 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity May 26 17:02:18.566630 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Connection: close May 26 17:02:18.566630 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Length: 0 May 26 17:02:18.566630 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Type: application/json May 26 17:02:18.566630 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Host: 10.222.0.102 May 26 17:02:18.566630 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None May 26 17:02:18.566630 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 May 26 17:02:18.566630 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABij7BiyHwpXyrt5gouZdLSR2u247HLrYjemXZgQvKKvL_gKjh50uqCS18EIS9Fz-K4YX8tYAnNJ1wV14kiwAB02jbBtqzwSucC_mBuXxtMJigMQrPKQ8KbZZZS-Ddpdzpc4NsmLSF1WlBJg_r88uD0kjqGmk19u_c3hfGh7S_nxL5xe64 May 26 17:02:18.566630 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Id: None May 26 17:02:18.566630 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Name: None May 26 17:02:18.566630 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed May 26 17:02:18.566630 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True May 26 17:02:18.566630 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default May 26 17:02:18.566630 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default May 26 17:02:18.566630 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Id: c56b7ca2b1f54ae782302bead8a35b01 May 26 17:02:18.566630 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-AttachVolumeNegativeTest-482187288 May 26 17:02:18.566630 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Role: reader,member May 26 17:02:18.566630 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Roles: reader,member May 26 17:02:18.568651 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 17:02:18.568651 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-AttachVolumeNegativeTest-482187288 May 26 17:02:18.568651 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Id: c56b7ca2b1f54ae782302bead8a35b01 May 26 17:02:18.568651 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-482187288 May 26 17:02:18.568651 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User: tempest-AttachVolumeNegativeTest-482187288-project May 26 17:02:18.568651 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default May 26 17:02:18.568651 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default May 26 17:02:18.568651 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Id: 75cc85261ad441f8993877a959bdd97b May 26 17:02:18.568651 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-AttachVolumeNegativeTest-482187288-project May 26 17:02:18.568651 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: method: > May 26 17:02:18.568651 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: exception: Instance 24c028a0-09ee-4151-b397-796cd8b211e3 could not be found. May 26 17:02:18.568651 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: action_args: {'id': '24c028a0-09ee-4151-b397-796cd8b211e3'} May 26 17:02:18.570215 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:02:18.570215 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:18.570215 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:02:18.570215 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:02:18.570215 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:02:18.570215 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:02:18.570215 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:02:18.570215 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:02:18.570215 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:02:18.570215 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:02:18.570215 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24c028a0-09ee-4151-b397-796cd8b211e3 could not be found. May 26 17:02:18.570215 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 17:02:18.570215 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:18.570215 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 17:02:18.570215 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:18.570215 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:18.570215 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:18.570215 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:02:18.570215 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:02:18.570215 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:02:18.571889 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:02:18.571889 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 17:02:18.571889 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 17:02:18.571889 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 17:02:18.571889 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 17:02:18.571889 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:02:18.571889 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:02:18.571889 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:02:18.571889 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:02:18.571889 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24c028a0-09ee-4151-b397-796cd8b211e3 could not be found. May 26 17:02:18.571889 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 17:02:18.571889 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:18.571889 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 17:02:18.571889 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:18.571889 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:18.571889 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:18.571889 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:02:18.571889 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:02:18.571889 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24c028a0-09ee-4151-b397-796cd8b211e3 could not be found. May 26 17:02:18.571889 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 17:02:18.573585 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-0b827c3a-c122-4feb-97b9-9ec12898cfdd tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Returning 404 to user: Instance 24c028a0-09ee-4151-b397-796cd8b211e3 could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:02:18.573585 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-0b827c3a-c122-4feb-97b9-9ec12898cfdd tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "DELETE /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3" status: 404 len: 111 microversion: 2.1 time: 0.029910 May 26 17:02:18.573585 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 610/1212] 10.222.0.102 () {58 vars in 1243 bytes} [Thu May 26 17:02:18 2022] DELETE /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:02:18.577973 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-9a6d41f9-11e5-454b-af1e-2aa3dcb8343d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:18.578701 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-9a6d41f9-11e5-454b-af1e-2aa3dcb8343d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 24c028a0-09ee-4151-b397-796cd8b211e3] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:18.586606 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9a6d41f9-11e5-454b-af1e-2aa3dcb8343d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:18.587046 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9a6d41f9-11e5-454b-af1e-2aa3dcb8343d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:18.587879 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9a6d41f9-11e5-454b-af1e-2aa3dcb8343d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:18.588310 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-9a6d41f9-11e5-454b-af1e-2aa3dcb8343d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:18.601792 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.wsgi [None req-9a6d41f9-11e5-454b-af1e-2aa3dcb8343d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] HTTP exception thrown: Instance 24c028a0-09ee-4151-b397-796cd8b211e3 could not be found. May 26 17:02:18.603438 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-9a6d41f9-11e5-454b-af1e-2aa3dcb8343d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Request method failure captured: May 26 17:02:18.603438 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: request: GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3 HTTP/1.1 May 26 17:02:18.603438 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept: application/json May 26 17:02:18.603438 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept-Encoding: identity May 26 17:02:18.603438 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Connection: close May 26 17:02:18.603438 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Length: 0 May 26 17:02:18.603438 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Type: application/json May 26 17:02:18.603438 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Host: 10.222.0.102 May 26 17:02:18.603438 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Openstack-System-Scope: None May 26 17:02:18.603438 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: User-Agent: python-urllib3/1.26.9 May 26 17:02:18.603438 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Auth-Token: gAAAAABij7BiyHwpXyrt5gouZdLSR2u247HLrYjemXZgQvKKvL_gKjh50uqCS18EIS9Fz-K4YX8tYAnNJ1wV14kiwAB02jbBtqzwSucC_mBuXxtMJigMQrPKQ8KbZZZS-Ddpdzpc4NsmLSF1WlBJg_r88uD0kjqGmk19u_c3hfGh7S_nxL5xe64 May 26 17:02:18.603438 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Id: None May 26 17:02:18.603438 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Name: None May 26 17:02:18.603438 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Identity-Status: Confirmed May 26 17:02:18.603438 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Is-Admin-Project: True May 26 17:02:18.603438 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Id: default May 26 17:02:18.603438 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Name: Default May 26 17:02:18.603438 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Id: c56b7ca2b1f54ae782302bead8a35b01 May 26 17:02:18.603438 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Name: tempest-AttachVolumeNegativeTest-482187288 May 26 17:02:18.603438 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Role: reader,member May 26 17:02:18.603438 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Roles: reader,member May 26 17:02:18.605169 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 17:02:18.605169 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant: tempest-AttachVolumeNegativeTest-482187288 May 26 17:02:18.605169 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Id: c56b7ca2b1f54ae782302bead8a35b01 May 26 17:02:18.605169 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-482187288 May 26 17:02:18.605169 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User: tempest-AttachVolumeNegativeTest-482187288-project May 26 17:02:18.605169 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Id: default May 26 17:02:18.605169 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Name: Default May 26 17:02:18.605169 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Id: 75cc85261ad441f8993877a959bdd97b May 26 17:02:18.605169 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Name: tempest-AttachVolumeNegativeTest-482187288-project May 26 17:02:18.605169 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: method: > May 26 17:02:18.605169 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: exception: Instance 24c028a0-09ee-4151-b397-796cd8b211e3 could not be found. May 26 17:02:18.605169 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: action_args: {'id': '24c028a0-09ee-4151-b397-796cd8b211e3'} May 26 17:02:18.606146 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:02:18.606146 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:18.606146 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:02:18.606146 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:02:18.606146 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:02:18.606146 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:02:18.606146 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:02:18.606146 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:02:18.606146 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:02:18.606146 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:02:18.606146 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24c028a0-09ee-4151-b397-796cd8b211e3 could not be found. May 26 17:02:18.606146 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 17:02:18.606146 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:18.606146 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 17:02:18.606146 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:18.606146 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:18.606146 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:18.606146 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:02:18.606146 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:02:18.606146 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:02:18.607721 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:02:18.607721 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:02:18.607721 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:02:18.607721 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:02:18.607721 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:02:18.607721 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:02:18.607721 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:02:18.607721 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24c028a0-09ee-4151-b397-796cd8b211e3 could not be found. May 26 17:02:18.607721 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 17:02:18.607721 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:18.607721 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 17:02:18.607721 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:18.607721 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:18.607721 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:18.607721 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:02:18.607721 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:02:18.607721 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24c028a0-09ee-4151-b397-796cd8b211e3 could not be found. May 26 17:02:18.607721 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 17:02:18.609552 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-9a6d41f9-11e5-454b-af1e-2aa3dcb8343d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Returning 404 to user: Instance 24c028a0-09ee-4151-b397-796cd8b211e3 could not be found. {{(pid=124267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:02:18.609552 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-9a6d41f9-11e5-454b-af1e-2aa3dcb8343d tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3" status: 404 len: 111 microversion: 2.1 time: 0.030825 May 26 17:02:18.609552 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 603/1213] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 17:02:18 2022] GET /compute/v2.1/servers/24c028a0-09ee-4151-b397-796cd8b211e3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:02:19.744129 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-86914336-7180-4f76-9a91-d97ac711ac4e tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:19.744686 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-86914336-7180-4f76-9a91-d97ac711ac4e tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:19.751085 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-86914336-7180-4f76-9a91-d97ac711ac4e tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:19.751535 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-86914336-7180-4f76-9a91-d97ac711ac4e tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:19.752322 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-86914336-7180-4f76-9a91-d97ac711ac4e tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:19.752781 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-86914336-7180-4f76-9a91-d97ac711ac4e tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:19.765795 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-86914336-7180-4f76-9a91-d97ac711ac4e tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] HTTP exception thrown: Instance 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 could not be found. May 26 17:02:19.767333 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-86914336-7180-4f76-9a91-d97ac711ac4e tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Request method failure captured: May 26 17:02:19.767333 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: request: DELETE /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 HTTP/1.1 May 26 17:02:19.767333 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept: application/json May 26 17:02:19.767333 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity May 26 17:02:19.767333 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Connection: close May 26 17:02:19.767333 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Length: 0 May 26 17:02:19.767333 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Type: application/json May 26 17:02:19.767333 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Host: 10.222.0.102 May 26 17:02:19.767333 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None May 26 17:02:19.767333 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 May 26 17:02:19.767333 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABij7BiyHwpXyrt5gouZdLSR2u247HLrYjemXZgQvKKvL_gKjh50uqCS18EIS9Fz-K4YX8tYAnNJ1wV14kiwAB02jbBtqzwSucC_mBuXxtMJigMQrPKQ8KbZZZS-Ddpdzpc4NsmLSF1WlBJg_r88uD0kjqGmk19u_c3hfGh7S_nxL5xe64 May 26 17:02:19.767333 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Id: None May 26 17:02:19.767333 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Name: None May 26 17:02:19.767333 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed May 26 17:02:19.767333 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True May 26 17:02:19.767333 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default May 26 17:02:19.767333 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default May 26 17:02:19.767333 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Id: c56b7ca2b1f54ae782302bead8a35b01 May 26 17:02:19.767333 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-AttachVolumeNegativeTest-482187288 May 26 17:02:19.767333 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Role: reader,member May 26 17:02:19.767333 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Roles: reader,member May 26 17:02:19.769120 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 17:02:19.769120 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-AttachVolumeNegativeTest-482187288 May 26 17:02:19.769120 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Id: c56b7ca2b1f54ae782302bead8a35b01 May 26 17:02:19.769120 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-482187288 May 26 17:02:19.769120 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User: tempest-AttachVolumeNegativeTest-482187288-project May 26 17:02:19.769120 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default May 26 17:02:19.769120 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default May 26 17:02:19.769120 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Id: 75cc85261ad441f8993877a959bdd97b May 26 17:02:19.769120 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-AttachVolumeNegativeTest-482187288-project May 26 17:02:19.769120 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: method: > May 26 17:02:19.769120 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: exception: Instance 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 could not be found. May 26 17:02:19.769120 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: action_args: {'id': '09cc4140-fc5a-40fb-a615-76e1a4e9f7d3'} May 26 17:02:19.772890 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:02:19.772890 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:19.772890 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:02:19.772890 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:02:19.772890 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:02:19.772890 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:02:19.772890 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:02:19.772890 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:02:19.772890 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:02:19.772890 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:02:19.772890 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 could not be found. May 26 17:02:19.772890 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 17:02:19.772890 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:19.772890 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 17:02:19.772890 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:19.772890 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:19.772890 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:19.772890 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:02:19.772890 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:02:19.772890 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:02:19.774470 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:02:19.774470 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 17:02:19.774470 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 17:02:19.774470 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 17:02:19.774470 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 17:02:19.774470 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:02:19.774470 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:02:19.774470 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:02:19.774470 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:02:19.774470 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 could not be found. May 26 17:02:19.774470 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 17:02:19.774470 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:19.774470 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 17:02:19.774470 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:19.774470 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:19.774470 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:19.774470 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:02:19.774470 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:02:19.774470 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 could not be found. May 26 17:02:19.774470 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 17:02:19.776146 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-86914336-7180-4f76-9a91-d97ac711ac4e tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Returning 404 to user: Instance 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:02:19.776146 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-86914336-7180-4f76-9a91-d97ac711ac4e tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "DELETE /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3" status: 404 len: 111 microversion: 2.1 time: 0.029417 May 26 17:02:19.776146 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 611/1214] 10.222.0.102 () {58 vars in 1243 bytes} [Thu May 26 17:02:19 2022] DELETE /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:02:19.776872 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-fa7a02de-c607-4ae2-be4f-038184886a5c tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:19.777478 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-fa7a02de-c607-4ae2-be4f-038184886a5c tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:19.783823 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fa7a02de-c607-4ae2-be4f-038184886a5c tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:19.784273 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fa7a02de-c607-4ae2-be4f-038184886a5c tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:19.785076 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fa7a02de-c607-4ae2-be4f-038184886a5c tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:19.785512 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-fa7a02de-c607-4ae2-be4f-038184886a5c tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:19.799129 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.wsgi [None req-fa7a02de-c607-4ae2-be4f-038184886a5c tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] HTTP exception thrown: Instance 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 could not be found. May 26 17:02:19.800663 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-fa7a02de-c607-4ae2-be4f-038184886a5c tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Request method failure captured: May 26 17:02:19.800663 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: request: GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 HTTP/1.1 May 26 17:02:19.800663 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept: application/json May 26 17:02:19.800663 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept-Encoding: identity May 26 17:02:19.800663 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Connection: close May 26 17:02:19.800663 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Length: 0 May 26 17:02:19.800663 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Type: application/json May 26 17:02:19.800663 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Host: 10.222.0.102 May 26 17:02:19.800663 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Openstack-System-Scope: None May 26 17:02:19.800663 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: User-Agent: python-urllib3/1.26.9 May 26 17:02:19.800663 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Auth-Token: gAAAAABij7BiyHwpXyrt5gouZdLSR2u247HLrYjemXZgQvKKvL_gKjh50uqCS18EIS9Fz-K4YX8tYAnNJ1wV14kiwAB02jbBtqzwSucC_mBuXxtMJigMQrPKQ8KbZZZS-Ddpdzpc4NsmLSF1WlBJg_r88uD0kjqGmk19u_c3hfGh7S_nxL5xe64 May 26 17:02:19.800663 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Id: None May 26 17:02:19.800663 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Name: None May 26 17:02:19.800663 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Identity-Status: Confirmed May 26 17:02:19.800663 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Is-Admin-Project: True May 26 17:02:19.800663 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Id: default May 26 17:02:19.800663 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Name: Default May 26 17:02:19.800663 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Id: c56b7ca2b1f54ae782302bead8a35b01 May 26 17:02:19.800663 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Name: tempest-AttachVolumeNegativeTest-482187288 May 26 17:02:19.800663 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Role: reader,member May 26 17:02:19.800663 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Roles: reader,member May 26 17:02:19.802398 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 17:02:19.802398 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant: tempest-AttachVolumeNegativeTest-482187288 May 26 17:02:19.802398 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Id: c56b7ca2b1f54ae782302bead8a35b01 May 26 17:02:19.802398 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-482187288 May 26 17:02:19.802398 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User: tempest-AttachVolumeNegativeTest-482187288-project May 26 17:02:19.802398 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Id: default May 26 17:02:19.802398 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Name: Default May 26 17:02:19.802398 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Id: 75cc85261ad441f8993877a959bdd97b May 26 17:02:19.802398 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Name: tempest-AttachVolumeNegativeTest-482187288-project May 26 17:02:19.802398 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: method: > May 26 17:02:19.802398 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: exception: Instance 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 could not be found. May 26 17:02:19.802398 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: action_args: {'id': '09cc4140-fc5a-40fb-a615-76e1a4e9f7d3'} May 26 17:02:19.803470 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:02:19.803470 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:19.803470 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:02:19.803470 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:02:19.803470 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:02:19.803470 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:02:19.803470 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:02:19.803470 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:02:19.803470 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:02:19.803470 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:02:19.803470 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 could not be found. May 26 17:02:19.803470 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 17:02:19.803470 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:19.803470 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 17:02:19.803470 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:19.803470 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:19.803470 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:19.803470 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:02:19.803470 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:02:19.803470 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:02:19.805622 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:02:19.805622 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:02:19.805622 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:02:19.805622 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:02:19.805622 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:02:19.805622 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:02:19.805622 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:02:19.805622 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 could not be found. May 26 17:02:19.805622 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 17:02:19.805622 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:19.805622 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 17:02:19.805622 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:19.805622 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:19.805622 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:19.805622 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:02:19.805622 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:02:19.805622 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 could not be found. May 26 17:02:19.805622 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 17:02:19.807081 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-fa7a02de-c607-4ae2-be4f-038184886a5c tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Returning 404 to user: Instance 09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 could not be found. {{(pid=124267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:02:19.807081 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-fa7a02de-c607-4ae2-be4f-038184886a5c tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3" status: 404 len: 111 microversion: 2.1 time: 0.028938 May 26 17:02:19.807081 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 604/1215] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 17:02:19 2022] GET /compute/v2.1/servers/09cc4140-fc5a-40fb-a615-76e1a4e9f7d3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 17:02:19.812255 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-92964f7f-7abc-4720-af55-b85362c45bb3 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:19.812793 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-92964f7f-7abc-4720-af55-b85362c45bb3 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 97945b79-f060-4f05-aa03-9c46f87623ac] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:19.818927 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-92964f7f-7abc-4720-af55-b85362c45bb3 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:19.819371 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-92964f7f-7abc-4720-af55-b85362c45bb3 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:19.820119 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-92964f7f-7abc-4720-af55-b85362c45bb3 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:19.820579 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-92964f7f-7abc-4720-af55-b85362c45bb3 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:19.833534 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-92964f7f-7abc-4720-af55-b85362c45bb3 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] HTTP exception thrown: Instance 97945b79-f060-4f05-aa03-9c46f87623ac could not be found. May 26 17:02:19.835031 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-92964f7f-7abc-4720-af55-b85362c45bb3 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Request method failure captured: May 26 17:02:19.835031 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: request: DELETE /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac HTTP/1.1 May 26 17:02:19.835031 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept: application/json May 26 17:02:19.835031 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity May 26 17:02:19.835031 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Connection: close May 26 17:02:19.835031 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Length: 0 May 26 17:02:19.835031 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Type: application/json May 26 17:02:19.835031 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Host: 10.222.0.102 May 26 17:02:19.835031 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None May 26 17:02:19.835031 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 May 26 17:02:19.835031 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABij7BiyHwpXyrt5gouZdLSR2u247HLrYjemXZgQvKKvL_gKjh50uqCS18EIS9Fz-K4YX8tYAnNJ1wV14kiwAB02jbBtqzwSucC_mBuXxtMJigMQrPKQ8KbZZZS-Ddpdzpc4NsmLSF1WlBJg_r88uD0kjqGmk19u_c3hfGh7S_nxL5xe64 May 26 17:02:19.835031 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Id: None May 26 17:02:19.835031 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Name: None May 26 17:02:19.835031 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed May 26 17:02:19.835031 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True May 26 17:02:19.835031 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default May 26 17:02:19.835031 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default May 26 17:02:19.835031 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Id: c56b7ca2b1f54ae782302bead8a35b01 May 26 17:02:19.835031 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-AttachVolumeNegativeTest-482187288 May 26 17:02:19.835031 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Role: reader,member May 26 17:02:19.835031 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Roles: reader,member May 26 17:02:19.836790 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 17:02:19.836790 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-AttachVolumeNegativeTest-482187288 May 26 17:02:19.836790 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Id: c56b7ca2b1f54ae782302bead8a35b01 May 26 17:02:19.836790 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-482187288 May 26 17:02:19.836790 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User: tempest-AttachVolumeNegativeTest-482187288-project May 26 17:02:19.836790 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default May 26 17:02:19.836790 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default May 26 17:02:19.836790 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Id: 75cc85261ad441f8993877a959bdd97b May 26 17:02:19.836790 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-AttachVolumeNegativeTest-482187288-project May 26 17:02:19.836790 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: method: > May 26 17:02:19.836790 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: exception: Instance 97945b79-f060-4f05-aa03-9c46f87623ac could not be found. May 26 17:02:19.836790 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: action_args: {'id': '97945b79-f060-4f05-aa03-9c46f87623ac'} May 26 17:02:19.837810 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:02:19.837810 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:19.837810 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:02:19.837810 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:02:19.837810 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:02:19.837810 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:02:19.837810 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:02:19.837810 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:02:19.837810 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:02:19.837810 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:02:19.837810 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97945b79-f060-4f05-aa03-9c46f87623ac could not be found. May 26 17:02:19.837810 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 17:02:19.837810 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:19.837810 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 17:02:19.837810 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:19.837810 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:19.837810 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:19.837810 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:02:19.837810 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:02:19.837810 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:02:19.839422 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:02:19.839422 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 17:02:19.839422 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 17:02:19.839422 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 17:02:19.839422 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 17:02:19.839422 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:02:19.839422 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:02:19.839422 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:02:19.839422 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:02:19.839422 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97945b79-f060-4f05-aa03-9c46f87623ac could not be found. May 26 17:02:19.839422 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 17:02:19.839422 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:19.839422 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 17:02:19.839422 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:19.839422 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:19.839422 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:19.839422 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:02:19.839422 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:02:19.839422 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97945b79-f060-4f05-aa03-9c46f87623ac could not be found. May 26 17:02:19.839422 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 17:02:19.841316 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-92964f7f-7abc-4720-af55-b85362c45bb3 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Returning 404 to user: Instance 97945b79-f060-4f05-aa03-9c46f87623ac could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:02:19.841316 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-92964f7f-7abc-4720-af55-b85362c45bb3 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "DELETE /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac" status: 404 len: 111 microversion: 2.1 time: 0.027949 May 26 17:02:19.841316 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 612/1216] 10.222.0.102 () {58 vars in 1243 bytes} [Thu May 26 17:02:19 2022] DELETE /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:02:19.844716 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-3c143e67-b1ce-4e9d-a8d0-3485b2dee41c tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:19.845329 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-3c143e67-b1ce-4e9d-a8d0-3485b2dee41c tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 97945b79-f060-4f05-aa03-9c46f87623ac] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:19.852082 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3c143e67-b1ce-4e9d-a8d0-3485b2dee41c tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:19.852563 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3c143e67-b1ce-4e9d-a8d0-3485b2dee41c tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:19.853324 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3c143e67-b1ce-4e9d-a8d0-3485b2dee41c tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:19.853756 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-3c143e67-b1ce-4e9d-a8d0-3485b2dee41c tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:19.867526 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.wsgi [None req-3c143e67-b1ce-4e9d-a8d0-3485b2dee41c tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] HTTP exception thrown: Instance 97945b79-f060-4f05-aa03-9c46f87623ac could not be found. May 26 17:02:19.869030 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-3c143e67-b1ce-4e9d-a8d0-3485b2dee41c tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Request method failure captured: May 26 17:02:19.869030 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: request: GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac HTTP/1.1 May 26 17:02:19.869030 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept: application/json May 26 17:02:19.869030 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept-Encoding: identity May 26 17:02:19.869030 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Connection: close May 26 17:02:19.869030 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Length: 0 May 26 17:02:19.869030 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Type: application/json May 26 17:02:19.869030 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Host: 10.222.0.102 May 26 17:02:19.869030 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Openstack-System-Scope: None May 26 17:02:19.869030 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: User-Agent: python-urllib3/1.26.9 May 26 17:02:19.869030 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Auth-Token: gAAAAABij7BiyHwpXyrt5gouZdLSR2u247HLrYjemXZgQvKKvL_gKjh50uqCS18EIS9Fz-K4YX8tYAnNJ1wV14kiwAB02jbBtqzwSucC_mBuXxtMJigMQrPKQ8KbZZZS-Ddpdzpc4NsmLSF1WlBJg_r88uD0kjqGmk19u_c3hfGh7S_nxL5xe64 May 26 17:02:19.869030 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Id: None May 26 17:02:19.869030 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Name: None May 26 17:02:19.869030 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Identity-Status: Confirmed May 26 17:02:19.869030 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Is-Admin-Project: True May 26 17:02:19.869030 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Id: default May 26 17:02:19.869030 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Name: Default May 26 17:02:19.869030 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Id: c56b7ca2b1f54ae782302bead8a35b01 May 26 17:02:19.869030 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Name: tempest-AttachVolumeNegativeTest-482187288 May 26 17:02:19.869030 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Role: reader,member May 26 17:02:19.869030 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Roles: reader,member May 26 17:02:19.870716 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 17:02:19.870716 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant: tempest-AttachVolumeNegativeTest-482187288 May 26 17:02:19.870716 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Id: c56b7ca2b1f54ae782302bead8a35b01 May 26 17:02:19.870716 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-482187288 May 26 17:02:19.870716 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User: tempest-AttachVolumeNegativeTest-482187288-project May 26 17:02:19.870716 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Id: default May 26 17:02:19.870716 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Name: Default May 26 17:02:19.870716 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Id: 75cc85261ad441f8993877a959bdd97b May 26 17:02:19.870716 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Name: tempest-AttachVolumeNegativeTest-482187288-project May 26 17:02:19.870716 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: method: > May 26 17:02:19.870716 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: exception: Instance 97945b79-f060-4f05-aa03-9c46f87623ac could not be found. May 26 17:02:19.870716 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: action_args: {'id': '97945b79-f060-4f05-aa03-9c46f87623ac'} May 26 17:02:19.871669 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:02:19.871669 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:19.871669 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:02:19.871669 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:02:19.871669 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:02:19.871669 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:02:19.871669 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:02:19.871669 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:02:19.871669 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:02:19.871669 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:02:19.871669 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97945b79-f060-4f05-aa03-9c46f87623ac could not be found. May 26 17:02:19.871669 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 17:02:19.871669 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:19.871669 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 17:02:19.871669 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:19.871669 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:19.871669 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:19.871669 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:02:19.871669 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:02:19.871669 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:02:19.873333 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:02:19.873333 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:02:19.873333 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:02:19.873333 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:02:19.873333 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:02:19.873333 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:02:19.873333 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:02:19.873333 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97945b79-f060-4f05-aa03-9c46f87623ac could not be found. May 26 17:02:19.873333 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 17:02:19.873333 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:19.873333 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 17:02:19.873333 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:19.873333 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:19.873333 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:19.873333 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:02:19.873333 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:02:19.873333 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97945b79-f060-4f05-aa03-9c46f87623ac could not be found. May 26 17:02:19.873333 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 17:02:19.874773 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-3c143e67-b1ce-4e9d-a8d0-3485b2dee41c tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Returning 404 to user: Instance 97945b79-f060-4f05-aa03-9c46f87623ac could not be found. {{(pid=124267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:02:19.874773 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-3c143e67-b1ce-4e9d-a8d0-3485b2dee41c tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac" status: 404 len: 111 microversion: 2.1 time: 0.029455 May 26 17:02:19.874773 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 605/1217] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 17:02:19 2022] GET /compute/v2.1/servers/97945b79-f060-4f05-aa03-9c46f87623ac => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:02:21.002327 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-55b86d8e-c032-4f1b-ab2a-3cb731bc0fd7 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:21.002826 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.compute.api [None req-55b86d8e-c032-4f1b-ab2a-3cb731bc0fd7 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3] Fetching instance by UUID {{(pid=124266) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:21.009312 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-55b86d8e-c032-4f1b-ab2a-3cb731bc0fd7 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:21.009871 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-55b86d8e-c032-4f1b-ab2a-3cb731bc0fd7 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:21.010701 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-55b86d8e-c032-4f1b-ab2a-3cb731bc0fd7 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:21.011210 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG oslo_concurrency.lockutils [None req-55b86d8e-c032-4f1b-ab2a-3cb731bc0fd7 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:21.025144 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.wsgi [None req-55b86d8e-c032-4f1b-ab2a-3cb731bc0fd7 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] HTTP exception thrown: Instance 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 could not be found. May 26 17:02:21.026670 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-55b86d8e-c032-4f1b-ab2a-3cb731bc0fd7 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Request method failure captured: May 26 17:02:21.026670 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: request: DELETE /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 HTTP/1.1 May 26 17:02:21.026670 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept: application/json May 26 17:02:21.026670 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Accept-Encoding: identity May 26 17:02:21.026670 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Connection: close May 26 17:02:21.026670 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Length: 0 May 26 17:02:21.026670 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Content-Type: application/json May 26 17:02:21.026670 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Host: 10.222.0.102 May 26 17:02:21.026670 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Openstack-System-Scope: None May 26 17:02:21.026670 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: User-Agent: python-urllib3/1.26.9 May 26 17:02:21.026670 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Auth-Token: gAAAAABij7BiyHwpXyrt5gouZdLSR2u247HLrYjemXZgQvKKvL_gKjh50uqCS18EIS9Fz-K4YX8tYAnNJ1wV14kiwAB02jbBtqzwSucC_mBuXxtMJigMQrPKQ8KbZZZS-Ddpdzpc4NsmLSF1WlBJg_r88uD0kjqGmk19u_c3hfGh7S_nxL5xe64 May 26 17:02:21.026670 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Id: None May 26 17:02:21.026670 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Domain-Name: None May 26 17:02:21.026670 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Identity-Status: Confirmed May 26 17:02:21.026670 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Is-Admin-Project: True May 26 17:02:21.026670 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Id: default May 26 17:02:21.026670 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Domain-Name: Default May 26 17:02:21.026670 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Id: c56b7ca2b1f54ae782302bead8a35b01 May 26 17:02:21.026670 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Project-Name: tempest-AttachVolumeNegativeTest-482187288 May 26 17:02:21.026670 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Role: reader,member May 26 17:02:21.026670 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Roles: reader,member May 26 17:02:21.028244 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 17:02:21.028244 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant: tempest-AttachVolumeNegativeTest-482187288 May 26 17:02:21.028244 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Id: c56b7ca2b1f54ae782302bead8a35b01 May 26 17:02:21.028244 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-482187288 May 26 17:02:21.028244 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User: tempest-AttachVolumeNegativeTest-482187288-project May 26 17:02:21.028244 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Id: default May 26 17:02:21.028244 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Domain-Name: Default May 26 17:02:21.028244 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Id: 75cc85261ad441f8993877a959bdd97b May 26 17:02:21.028244 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: X-User-Name: tempest-AttachVolumeNegativeTest-482187288-project May 26 17:02:21.028244 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: method: > May 26 17:02:21.028244 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: exception: Instance 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 could not be found. May 26 17:02:21.028244 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: action_args: {'id': '48502e6c-e7ed-4b82-9045-1e2c9a2be1d3'} May 26 17:02:21.029147 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: {{(pid=124266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:02:21.029147 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:21.029147 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:02:21.029147 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:02:21.029147 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:02:21.029147 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:02:21.029147 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:02:21.029147 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:02:21.029147 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:02:21.029147 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:02:21.029147 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 could not be found. May 26 17:02:21.029147 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 17:02:21.029147 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:21.029147 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 17:02:21.029147 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:21.029147 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:21.029147 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:21.029147 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:02:21.029147 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:02:21.029147 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:02:21.030869 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:02:21.030869 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 17:02:21.030869 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 17:02:21.030869 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 17:02:21.030869 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 17:02:21.030869 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:02:21.030869 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:02:21.030869 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:02:21.030869 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:02:21.030869 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 could not be found. May 26 17:02:21.030869 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 17:02:21.030869 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:21.030869 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 17:02:21.030869 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:21.030869 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:21.030869 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:21.030869 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:02:21.030869 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:02:21.030869 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 could not be found. May 26 17:02:21.030869 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: ERROR nova.api.openstack.wsgi May 26 17:02:21.032810 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: DEBUG nova.api.openstack.wsgi [None req-55b86d8e-c032-4f1b-ab2a-3cb731bc0fd7 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Returning 404 to user: Instance 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 could not be found. {{(pid=124266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:02:21.032810 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO nova.api.openstack.requestlog [None req-55b86d8e-c032-4f1b-ab2a-3cb731bc0fd7 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "DELETE /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3" status: 404 len: 111 microversion: 2.1 time: 0.029606 May 26 17:02:21.032810 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: [pid: 124266|app: 0|req: 613/1218] 10.222.0.102 () {58 vars in 1243 bytes} [Thu May 26 17:02:20 2022] DELETE /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:02:21.036478 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-00457297-99b5-435f-9ab0-2d967c8eb690 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Calling method '>' {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:21.037097 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.compute.api [None req-00457297-99b5-435f-9ab0-2d967c8eb690 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] [instance: 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3] Fetching instance by UUID {{(pid=124267) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:21.044486 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-00457297-99b5-435f-9ab0-2d967c8eb690 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:21.044927 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-00457297-99b5-435f-9ab0-2d967c8eb690 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:21.045698 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-00457297-99b5-435f-9ab0-2d967c8eb690 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:21.046139 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG oslo_concurrency.lockutils [None req-00457297-99b5-435f-9ab0-2d967c8eb690 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Lock "97163b7c-dec1-42e2-8be2-4fecb8140df7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:21.059514 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.wsgi [None req-00457297-99b5-435f-9ab0-2d967c8eb690 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] HTTP exception thrown: Instance 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 could not be found. May 26 17:02:21.061072 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-00457297-99b5-435f-9ab0-2d967c8eb690 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Request method failure captured: May 26 17:02:21.061072 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: request: GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 HTTP/1.1 May 26 17:02:21.061072 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept: application/json May 26 17:02:21.061072 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Accept-Encoding: identity May 26 17:02:21.061072 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Connection: close May 26 17:02:21.061072 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Length: 0 May 26 17:02:21.061072 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Content-Type: application/json May 26 17:02:21.061072 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Host: 10.222.0.102 May 26 17:02:21.061072 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Openstack-System-Scope: None May 26 17:02:21.061072 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: User-Agent: python-urllib3/1.26.9 May 26 17:02:21.061072 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Auth-Token: gAAAAABij7BiyHwpXyrt5gouZdLSR2u247HLrYjemXZgQvKKvL_gKjh50uqCS18EIS9Fz-K4YX8tYAnNJ1wV14kiwAB02jbBtqzwSucC_mBuXxtMJigMQrPKQ8KbZZZS-Ddpdzpc4NsmLSF1WlBJg_r88uD0kjqGmk19u_c3hfGh7S_nxL5xe64 May 26 17:02:21.061072 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Id: None May 26 17:02:21.061072 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Domain-Name: None May 26 17:02:21.061072 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Identity-Status: Confirmed May 26 17:02:21.061072 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Is-Admin-Project: True May 26 17:02:21.061072 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Id: default May 26 17:02:21.061072 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Domain-Name: Default May 26 17:02:21.061072 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Id: c56b7ca2b1f54ae782302bead8a35b01 May 26 17:02:21.061072 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Project-Name: tempest-AttachVolumeNegativeTest-482187288 May 26 17:02:21.061072 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Role: reader,member May 26 17:02:21.061072 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Roles: reader,member May 26 17:02:21.062793 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_c56b7ca2b1f54ae782302bead8a35b01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] May 26 17:02:21.062793 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant: tempest-AttachVolumeNegativeTest-482187288 May 26 17:02:21.062793 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Id: c56b7ca2b1f54ae782302bead8a35b01 May 26 17:02:21.062793 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-482187288 May 26 17:02:21.062793 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User: tempest-AttachVolumeNegativeTest-482187288-project May 26 17:02:21.062793 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Id: default May 26 17:02:21.062793 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Domain-Name: Default May 26 17:02:21.062793 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Id: 75cc85261ad441f8993877a959bdd97b May 26 17:02:21.062793 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: X-User-Name: tempest-AttachVolumeNegativeTest-482187288-project May 26 17:02:21.062793 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: method: > May 26 17:02:21.062793 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: exception: Instance 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 could not be found. May 26 17:02:21.062793 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: action_args: {'id': '48502e6c-e7ed-4b82-9045-1e2c9a2be1d3'} May 26 17:02:21.063748 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: {{(pid=124267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:02:21.063748 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:21.063748 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:02:21.063748 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:02:21.063748 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:02:21.063748 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:02:21.063748 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:02:21.063748 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:02:21.063748 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:02:21.063748 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:02:21.063748 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 could not be found. May 26 17:02:21.063748 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 17:02:21.063748 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:21.063748 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 17:02:21.063748 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:21.063748 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:21.063748 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:21.063748 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:02:21.063748 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:02:21.063748 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:02:21.065388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:02:21.065388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:02:21.065388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:02:21.065388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:02:21.065388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:02:21.065388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:02:21.065388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:02:21.065388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 could not be found. May 26 17:02:21.065388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 17:02:21.065388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:21.065388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 17:02:21.065388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:21.065388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:21.065388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:21.065388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:02:21.065388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:02:21.065388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 could not be found. May 26 17:02:21.065388 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: ERROR nova.api.openstack.wsgi May 26 17:02:21.066929 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: DEBUG nova.api.openstack.wsgi [None req-00457297-99b5-435f-9ab0-2d967c8eb690 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] Returning 404 to user: Instance 48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 could not be found. {{(pid=124267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:02:21.066929 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO nova.api.openstack.requestlog [None req-00457297-99b5-435f-9ab0-2d967c8eb690 tempest-AttachVolumeNegativeTest-482187288 tempest-AttachVolumeNegativeTest-482187288-project] 10.222.0.102 "GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3" status: 404 len: 111 microversion: 2.1 time: 0.029765 May 26 17:02:21.066929 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: [pid: 124267|app: 0|req: 606/1219] 10.222.0.102 () {58 vars in 1240 bytes} [Thu May 26 17:02:21 2022] GET /compute/v2.1/servers/48502e6c-e7ed-4b82-9045-1e2c9a2be1d3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 17:04:37.358530 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 17:04:37.359052 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Thu May 26 17:04:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 17:04:51.890770 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 17:04:51.891429 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Thu May 26 17:04:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 17:04:52.421343 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 17:04:52.421859 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Thu May 26 17:04:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 17:06:03.846024 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 17:06:03.846642 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Thu May 26 17:06:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 17:06:10.820383 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 17:06:10.821020 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Thu May 26 17:06:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 17:07:57.366693 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 17:07:57.367826 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Thu May 26 17:07:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 17:07:58.860829 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 17:07:58.861407 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Thu May 26 17:07:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 17:08:11.898940 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 17:08:11.899633 dv-cinder-836071-5-iscsi devstack@n-api.service[124266]: Thu May 26 17:08:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 17:08:12.429430 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 17:08:12.429894 dv-cinder-836071-5-iscsi devstack@n-api.service[124267]: Thu May 26 17:08:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!